-- Logs begin at Fri 2022-06-24 08:57:35 UTC, end at Fri 2022-06-24 10:00:58 UTC. -- Jun 24 09:33:19.785315 dv-cinder-803823-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 09:33:19.793188 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 09:33:19.799866 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 09:33:19 2022] *** Jun 24 09:33:19.799866 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 09:33:19.799866 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 09:33:19.799866 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: nodename: dv-cinder-803823-13-iscsi Jun 24 09:33:19.799866 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: machine: x86_64 Jun 24 09:33:19.799866 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: clock source: unix Jun 24 09:33:19.799866 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: pcre jit disabled Jun 24 09:33:19.799866 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: detected number of CPU cores: 4 Jun 24 09:33:19.799866 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: current working directory: / Jun 24 09:33:19.799866 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: detected binary path: /usr/bin/uwsgi-core Jun 24 09:33:19.799866 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: your processes number limit is 47680 Jun 24 09:33:19.799866 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: your memory page size is 4096 bytes Jun 24 09:33:19.799866 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: detected max file descriptor number: 2048 Jun 24 09:33:19.799866 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: lock engine: pthread robust mutexes Jun 24 09:33:19.799866 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: thunder lock: enabled Jun 24 09:33:19.799866 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 09:33:19.799866 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 09:33:19.842599 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: Python main interpreter initialized at 0x55b7e3d069c0 Jun 24 09:33:19.842599 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: python threads support enabled Jun 24 09:33:19.842599 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: your server socket listen backlog is limited to 100 connections Jun 24 09:33:19.842599 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: your mercy for graceful operations on workers is 90 seconds Jun 24 09:33:19.843029 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 09:33:19.843029 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: *** Operational MODE: preforking *** Jun 24 09:33:19.843360 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: *** uWSGI is running in multiple interpreter mode *** Jun 24 09:33:19.843360 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: spawned uWSGI master process (pid: 109842) Jun 24 09:33:19.843589 dv-cinder-803823-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 09:33:19.844145 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: spawned uWSGI worker 1 (pid: 109843, cores: 1) Jun 24 09:33:19.844485 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: spawned uWSGI worker 2 (pid: 109844, cores: 1) Jun 24 09:33:19.844652 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 09:33:20.504818 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 09:33:20.505467 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 09:33:21.695272 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 09:33:21.695272 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: from cryptography.utils import int_from_bytes Jun 24 09:33:21.695954 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 09:33:21.695954 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: from cryptography.utils import int_from_bytes Jun 24 09:33:21.716598 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 09:33:21.716598 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: from cryptography.utils import int_from_bytes Jun 24 09:33:21.717107 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 09:33:21.717107 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: from cryptography.utils import int_from_bytes Jun 24 09:33:24.257926 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 09:33:24.258536 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 09:33:24.258720 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 09:33:24.259101 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 09:33:24.259359 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 09:33:24.259755 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.260087 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.260413 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.260736 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.261081 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.261384 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.261709 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.262014 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.262342 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.262603 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.262918 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.263285 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-13-iscsi {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.263613 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.263929 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.264242 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.264565 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.264856 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.265179 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.265486 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.265983 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.266432 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.266742 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.267055 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.267435 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.267753 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.268077 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.268388 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.268699 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.269029 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.269362 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.269755 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-13-iscsi {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.270071 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.270385 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.270703 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.271144 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.271507 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.271824 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.272334 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.272700 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.272978 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.273310 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.273631 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.273956 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.274279 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.274585 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.274898 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.275231 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.275557 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.275865 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.276174 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.276426 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.276738 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.277064 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.277387 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.277712 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.277967 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.278221 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.278540 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.278864 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.279204 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.279514 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.279824 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.280135 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.280442 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.280751 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.281060 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.281370 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.281690 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.282008 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.282331 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.282642 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.282964 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.283397 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.283649 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.283965 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.284307 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.284627 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.284938 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.285259 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.285583 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.285895 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.286204 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.286514 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.286834 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.287290 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.287607 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.287861 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.288162 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.288473 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.288794 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.289105 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.289418 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.289728 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.290033 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.290345 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.290654 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.290964 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.291298 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.291610 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.292036 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.292355 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.292667 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.292975 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.293298 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.293619 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.293930 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.294246 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.294555 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.294867 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.295212 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.295523 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.295832 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.296157 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.296466 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.296774 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.297093 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.297403 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.297712 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.298032 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.298333 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.298642 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.298963 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.299298 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.299609 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.299916 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.300222 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.300528 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.300835 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.301140 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.301447 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.301748 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.302072 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.302396 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.302774 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.303117 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.303433 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.303752 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:24.304101 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.304436 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.304782 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.305104 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.305441 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.305774 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.306097 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.306414 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.306734 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.307063 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.307404 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.307721 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.308037 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.308361 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.308686 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.309017 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.309335 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.309654 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.309977 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.310291 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.310611 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.310941 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.311289 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.311604 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.311948 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.312294 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.312611 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.312937 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.313263 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.313578 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.313888 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.314204 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.314527 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.314867 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.315205 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.315528 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.315843 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.316157 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.316470 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.316786 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.317099 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.317436 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.317753 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.318068 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.318554 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.319004 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.319472 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.319923 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.320394 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.320820 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.321246 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.325009 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.325009 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.325009 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.325009 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.325009 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.325009 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.325009 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.325009 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.325771 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.325771 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.325771 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.325771 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.325771 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.325771 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.326185 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.327175 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.327175 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.327175 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.327398 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.327631 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.327942 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.328268 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.328583 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.328901 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.329221 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.329540 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.329859 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.330274 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.330598 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.330939 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.331334 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.331643 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.331972 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.332298 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.332597 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.332923 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.333237 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.333540 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.333852 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.334285 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.334500 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.334807 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.335148 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.335458 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.335764 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.336071 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.336397 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.336710 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.337014 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.337318 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.337621 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.337966 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.338274 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.338603 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.338947 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.339297 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.339627 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.339949 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.340271 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.340590 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.340907 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.341224 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.341544 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.341869 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.342184 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.342533 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.342825 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.343183 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.343501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.343828 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.344136 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.344454 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.344801 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.345139 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.345460 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.345786 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.346103 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.346421 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.346764 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.347123 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.347423 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.347735 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.348058 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.348370 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.348693 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.349017 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.349342 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.349845 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.350302 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.350526 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.350847 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.351200 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.351543 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.351860 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.352176 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.352503 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.352820 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.353131 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.353489 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.353740 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.354049 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.354363 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.354681 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.354996 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.355337 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.355647 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.355967 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.356278 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.356588 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.356896 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.357210 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.357534 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.357849 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.358176 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.358500 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.358809 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.359147 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.359476 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.360145 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.360452 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.360760 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.361067 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.361411 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.361725 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.362033 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.362354 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.362679 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.362994 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.363344 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.363656 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.363970 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.364292 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.364608 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.364921 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.365365 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.365600 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.365915 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.366229 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.366554 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.366865 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.367204 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.367521 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.367827 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.368144 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.368462 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.369060 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.369398 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.369719 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.370039 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.370364 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.370686 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.371018 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.371378 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.371725 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.372036 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.372350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.372659 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.372966 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.373277 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.373585 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.373892 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.374198 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.374508 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.374815 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.375151 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.375459 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.375766 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.376082 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.376386 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.376699 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.377005 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.377327 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.377637 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.377944 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.378250 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.378554 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.378901 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.379232 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.379572 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.379901 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.380246 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.380554 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.380986 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.381313 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.381622 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.381929 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.382236 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.382547 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.382858 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.383191 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.383508 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.383820 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.384132 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.384440 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.384745 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.385054 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.385357 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.385673 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.385984 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.386290 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.386593 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.386908 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.387250 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.387555 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.387868 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.388173 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.388490 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.388898 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.389212 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.389521 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.389834 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.390148 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.390455 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.390780 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.391112 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.391426 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.391732 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.392044 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.392350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.392656 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.393064 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.393394 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.393714 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.394020 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.394331 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.394638 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.394944 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.395280 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.395593 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.395901 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.396208 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.396558 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.396869 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.397258 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.397590 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.397904 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.398211 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.398518 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.398826 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.399205 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.399515 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.399876 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.400184 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.400501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.400820 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.401136 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.401448 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.401763 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.402066 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.402384 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.402697 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.403012 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.403344 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.403652 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.403976 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.404289 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.404604 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.404926 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.405249 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.405574 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.405880 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.406191 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.406502 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.406813 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.407145 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.407458 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.407772 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.408085 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.408396 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.408709 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.409027 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.409335 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.409644 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.409954 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.410259 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.410582 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.410892 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.411226 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.411539 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.411845 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.412391 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.412720 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.413164 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.413484 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.413799 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.414107 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.414420 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.414735 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.415053 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.415393 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.415700 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.416118 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.416437 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.416751 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.417064 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.417371 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.417676 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.417989 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.418315 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.418622 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.418933 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.419267 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.419592 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.419898 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.420219 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.420634 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.420949 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.421258 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.421675 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.421986 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.422298 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.422622 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.422943 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.423292 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.423600 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.423914 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.424224 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.424549 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.424873 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.425187 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.425501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.425805 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.426127 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.426447 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.426761 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.427091 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.427515 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.427958 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.428277 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.428601 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.428938 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.429246 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.429551 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.429863 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.430171 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.430480 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.430802 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.431132 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.431450 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.431764 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.432074 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.432380 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.432685 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.433006 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.433312 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.433634 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.433949 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.434272 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.434594 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.434900 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.435251 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.435565 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.435871 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.436176 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.436482 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.436826 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.437133 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.437453 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.437787 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.438120 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.438432 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.438768 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.439112 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.439436 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.439755 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.440083 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.440389 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.440693 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.441006 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.441311 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.441618 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.441923 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.442233 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.442539 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.442845 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.443183 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.443650 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.443957 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.444285 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.444600 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.444909 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.445218 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.445522 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.445866 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.446174 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.446512 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.446835 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.447217 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.447553 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.447865 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.448194 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.448515 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.448842 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.449162 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.449480 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.449800 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.450118 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.450436 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.450748 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.451069 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.451413 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.451732 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.452306 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.452639 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.452956 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.453273 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.453591 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.453910 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.454229 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.454545 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.454860 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.455201 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.455521 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.455854 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.456182 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.456512 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.456849 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.457167 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.457484 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.457802 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.458119 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.458479 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.458806 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.459308 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.459636 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.459957 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.460275 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.460590 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.460910 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.461218 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.461533 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.461848 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.462162 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.462482 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.462799 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.463158 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.463498 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.463821 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.464138 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.464456 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.464773 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.465302 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.465622 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.465961 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.466289 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.466620 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.466940 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.467288 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.467619 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.467926 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.468233 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.468547 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.468864 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.469170 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.469494 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.469806 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.470111 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.470431 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.470741 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.471327 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.471680 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.472001 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.472332 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.472659 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.472979 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.473291 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.473617 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.473926 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.474252 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.474666 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.475001 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.475340 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.475651 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.475966 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.476280 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.476588 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.476902 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.477209 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.477540 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.477851 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.478159 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.478467 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.478784 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.479117 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.479428 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.479734 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.480040 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.480467 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.480667 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.480977 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.482044 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.482044 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.482044 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.482333 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.482534 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.482864 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.483201 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.483510 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.483836 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.484152 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.484480 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.485162 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.485476 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.485827 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.486145 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.486722 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.487063 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.487420 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.487768 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.488105 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.488418 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.488733 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.489046 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.489376 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.489691 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.490004 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.490379 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.490695 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.491017 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.491355 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.491668 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.491980 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.492291 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.492602 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.492914 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.493232 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.493540 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.493977 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.494329 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.494658 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.494981 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.495327 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.495648 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.495962 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.496275 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.496588 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.496899 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.497218 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.497550 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.497864 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.498174 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.498605 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.498929 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.499276 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.499602 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.499915 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.500242 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.500568 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.500884 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.501208 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.501521 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.501852 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.502196 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.502530 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.502856 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.503190 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.503502 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.503809 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.504123 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.504446 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.504763 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.505067 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.505373 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.505685 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.506109 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.506456 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.506850 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.507190 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.507510 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.507892 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.508324 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.508637 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.508897 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.509208 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.509518 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.509832 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.510142 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.510451 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.510760 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.511186 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.511405 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.511748 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.512084 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.512404 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.512729 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.513045 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.513384 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.513685 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.514009 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.514343 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.514651 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.514964 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.515324 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.515641 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.515957 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.516270 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.516586 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.516898 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.517233 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.517538 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.517869 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.518179 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.518507 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.518837 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.519190 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.519511 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.519826 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.520159 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.520487 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.520790 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.521110 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.521492 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.521954 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.522409 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.522801 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.523174 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.523510 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.523829 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.524164 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.524516 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.524861 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.525435 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.525731 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.526143 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.526470 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.526790 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.527128 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:24.527379 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 09:33:24.682834 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO dbcounter [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] Registered counter for database nova_api Jun 24 09:33:24.705276 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_db.sqlalchemy.engines [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:33:24.714217 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writer thread running {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:33:24.774048 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.context [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f2d2cbef-ff41-499b-a255-74c93eabe11c(cell1) {{(pid=109843) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 09:33:24.777983 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:33:24.779621 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:33:24.780439 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:33:24.782420 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:33:24.784516 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO dbcounter [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] Registered counter for database nova_cell0 Jun 24 09:33:24.788968 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO dbcounter [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] Registered counter for database nova_cell1 Jun 24 09:33:24.796835 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_db.sqlalchemy.engines [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:33:24.799327 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_db.sqlalchemy.engines [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:33:24.805244 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writer thread running {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:33:24.807002 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writer thread running {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:33:24.957925 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO dbcounter [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] Registered counter for database nova_cell0 Jun 24 09:33:24.965495 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_db.sqlalchemy.engines [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:33:24.970829 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writer thread running {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:33:25.061232 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 09:33:25.061823 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 09:33:25.062423 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 09:33:25.063020 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 09:33:25.063465 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 09:33:25.064098 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.064637 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.065205 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.065754 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.066311 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.066850 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.067428 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.067970 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.068556 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.069018 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.069626 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.070131 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-13-iscsi {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.070695 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.071254 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.071799 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.072352 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.072875 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.073409 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.073934 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.074811 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.075375 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.075906 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.076437 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.076996 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.077525 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.078065 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.078607 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.079106 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.079641 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.080172 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.080853 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-13-iscsi {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.081392 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.081935 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.082475 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.083211 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.083752 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.084293 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.084817 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.085343 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.085854 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.086359 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.086848 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.087364 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.087899 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.088394 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.088892 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.089415 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.089924 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.090440 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.090957 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.091405 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.091903 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.092442 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.092984 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.093531 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.093939 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.094360 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.094871 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.095427 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.095929 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.096479 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.097031 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.097615 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.098198 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.098803 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.099351 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.099945 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.100550 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.101082 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.101609 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.102118 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.102627 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.103315 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.103756 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.104313 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.104889 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.105387 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.105876 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.106387 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.106858 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.107372 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.107866 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.108388 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.108914 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.109848 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.110381 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.110807 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.111383 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.111862 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.112409 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.112956 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.113502 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.114050 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.114624 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.115330 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.116077 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.116734 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.117320 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.117779 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.118097 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.118411 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.118723 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.119033 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.119379 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.119702 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.120014 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.120321 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.120629 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.120936 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.121257 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.121563 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.121868 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.122191 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.122495 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.122801 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.123199 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.123511 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.123817 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.124132 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.124438 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.124747 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.125064 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.125465 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.125674 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.125975 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.126276 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.126577 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.126880 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.127203 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.127510 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.127807 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.128124 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.128441 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.128748 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.129055 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.129357 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.129671 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:33:25.130008 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.130336 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.130676 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.131154 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.131701 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.132038 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.132361 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.132676 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.132994 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.133322 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.133635 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.133949 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.134260 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.134583 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.134906 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.135262 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.135580 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.135896 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.136213 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.136523 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.136837 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.137163 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.137481 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.137788 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.138124 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.138468 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.138782 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.139126 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.139451 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.139760 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.140068 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.140377 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.140696 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.141028 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.141338 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.141655 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.141966 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.142275 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.142581 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.142888 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.143223 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.143556 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.143866 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.144176 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.144482 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.144802 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.145110 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.145418 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.145776 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.146030 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.146333 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.146751 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.147326 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.147643 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.147968 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.148298 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.148604 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.148937 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.149244 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.149553 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.149861 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.150168 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.150471 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.150781 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.151113 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.151410 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.151730 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.152038 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.152341 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.152662 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.152963 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.153264 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.153578 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.153884 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.154193 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.154503 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.154817 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.155175 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.155491 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.155807 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.156134 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.156459 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.156763 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.157081 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.157402 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.157714 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.158013 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.158319 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.158618 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.158919 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.159246 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.159552 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.159852 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.160152 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.160451 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.160748 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.161048 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.161364 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.161670 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.161972 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.162424 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.162955 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.163373 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.163680 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.164021 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.164356 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.164675 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.165003 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.165314 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.165628 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.165937 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.166247 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.166558 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.166867 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.167212 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.167522 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.167841 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.168145 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.168465 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.168773 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.169092 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.169393 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.169705 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.170040 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.170368 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.170680 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.170999 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.171330 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.171642 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.171948 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.172256 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.172564 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.172872 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.173188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.173496 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.173814 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.174121 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.174438 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.174749 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.175068 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.175390 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.175699 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.176022 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.176354 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.176661 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.176969 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.177288 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.177596 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.178114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.178601 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.178912 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.179241 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.179553 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.179871 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.180182 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.180492 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.180797 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.181112 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.181418 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.181723 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.182028 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.182337 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.182655 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.182967 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.183309 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.183629 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.183934 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.184237 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.184557 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.184873 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.185176 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.185479 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.185780 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.186121 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.186432 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.186732 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.187048 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.187390 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.187697 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.188010 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.188318 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.188624 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.188940 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.189249 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.189553 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.189861 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.190167 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.190475 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.190782 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.191115 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.191423 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.191731 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.192041 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.192340 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.192652 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.192963 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.193715 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.194287 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.194609 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.194935 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.195279 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.195599 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.195928 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.196253 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.196596 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.196897 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.197203 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.197505 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.197806 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.198113 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.198413 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.198714 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.199011 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.199344 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.199645 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.199944 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.200245 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.200544 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.200855 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.201151 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.201458 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.201758 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.202144 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.202381 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.202680 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.202978 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.203299 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.203637 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.203939 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.204271 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.204595 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.204937 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.205238 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.205537 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.205857 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.206156 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.206457 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.206759 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.207064 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.207399 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.207697 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.208005 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.208311 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.208614 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.208950 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.209375 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.209884 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.210196 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.210512 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.210820 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.211150 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.211454 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.211762 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.212069 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.212368 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.212671 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.212970 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.213281 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.213580 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.213879 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.214178 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.214483 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.214793 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.215108 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.215434 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.215745 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.216047 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.216347 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.216652 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.216954 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.217254 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.217561 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.217879 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.218192 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.218495 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.218802 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.219125 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.219431 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.219733 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.220039 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.220337 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.220639 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.220939 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.221240 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.221540 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.221859 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.222166 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.222468 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.222768 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.223087 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.223432 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.223737 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.224093 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.224398 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.224832 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.225402 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.225729 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.226043 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.226358 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.226663 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.226980 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.227315 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.227632 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.227937 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.228240 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.228560 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.228871 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.229178 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.229496 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.229815 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.230136 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.230437 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.230743 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.231051 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.231380 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.231686 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.231992 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.232301 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.232613 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.232919 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.233229 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.233537 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.233845 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.234152 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.234458 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.235151 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.235512 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.235782 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.236082 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.236389 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.236691 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.236998 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.237300 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.237728 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.238038 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.238347 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.238650 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.238958 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.239292 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.239608 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.239918 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.240285 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.241012 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.241340 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.241657 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.241971 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.242277 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.242585 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.242896 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.243248 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.243553 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.243857 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.244160 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.244478 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.244781 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.245108 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.245601 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.245916 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.246217 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.246627 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.246939 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.247268 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.247586 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.247904 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.248223 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.248524 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.248832 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.249135 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.249453 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.249770 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.250079 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.250389 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.250691 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.251007 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.251347 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.251658 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.251973 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.252380 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.252701 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.253008 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.253331 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.253649 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.253950 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.254249 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.254553 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.254860 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.255180 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.255497 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.255847 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.256350 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.256751 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.257066 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.257369 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.257671 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.257989 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.258292 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.258611 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.258919 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.259262 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.259579 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.259880 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.260195 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.260501 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.260801 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.261103 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.261402 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.261742 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.262041 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.262356 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.262683 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.263005 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.263338 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.263666 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.263989 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.264299 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.264613 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.264940 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.265240 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.265539 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.265845 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.266146 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.266442 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.266740 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.267044 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.267364 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.267661 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.267958 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.268276 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.268573 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.268891 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.269196 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.269495 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.269796 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.270095 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.270429 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.270727 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.271056 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.271436 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.271940 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.272350 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.272758 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.273084 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.273399 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.273713 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.274026 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.274338 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.274649 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.274967 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.275300 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.275609 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.275917 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.276230 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.276537 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.277101 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.277425 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.277737 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.278047 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.278355 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.278664 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.278974 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.279305 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.279612 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.279917 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.280223 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.280546 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.280865 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.281185 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.281517 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.281829 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.282142 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.282457 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.282766 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.283151 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.283466 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.283768 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.284098 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.284391 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.284700 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.285012 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.285318 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.285626 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.285933 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.286242 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.286545 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.286854 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.287296 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.287851 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.288290 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.288612 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.288924 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.289234 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.289545 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.290071 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.290383 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.290711 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.291033 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.291378 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.291690 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.292007 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.292328 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.292632 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.292929 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.293237 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.293539 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.293837 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.294155 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.294460 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.294759 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.295107 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.295408 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.295937 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.296287 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.296599 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.296920 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.297239 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.297554 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.297856 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.298176 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.298480 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.298781 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.299109 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.299417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.299720 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.300017 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.300323 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.300629 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.300928 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.301231 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.301530 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.301852 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.302154 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.302454 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.302832 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.303408 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.303749 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.304054 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.304361 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.304662 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.304981 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.305281 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.305588 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.305889 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.306198 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.306497 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.306803 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.307180 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.307521 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.307808 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.308107 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.308423 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.308732 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.309051 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.309364 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.309676 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.310018 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.310260 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: WARNING keystonemiddleware.auth_token [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 09:33:25.310749 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.310890 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.311226 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.311598 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.311886 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.312215 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.312518 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.312823 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.313126 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.313452 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.313758 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.314066 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.314373 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.314683 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.314997 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.315330 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.315636 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.315943 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.316250 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.316557 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.316859 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.317166 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.317470 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.317555 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: WARNING keystonemiddleware.auth_token [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 09:33:25.317782 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.318124 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.318517 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.319044 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.319518 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.319835 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.320149 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.320461 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.320771 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.321079 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.321395 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.321723 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.322034 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.322340 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.322761 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.323102 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.323429 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.323733 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.324040 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.324360 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.324679 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.325000 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.325320 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.325629 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.325955 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.326291 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.326623 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.326946 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.327271 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.327576 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.327879 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.328188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.328506 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.328813 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.329117 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.329422 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.329732 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.330036 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.330338 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.330640 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.330942 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.331274 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.331579 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.331877 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.332177 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.332478 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.332779 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.333078 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.333382 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.333681 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.334132 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.334473 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.334777 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.335104 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.335433 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.335765 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.336079 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.336399 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.336711 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.337030 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.337334 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.337652 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.338031 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.338282 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.338587 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.338916 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.339258 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.339571 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.339881 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.340189 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.340497 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.340804 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.341134 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.341459 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.341764 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.342087 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.342405 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.342722 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.343035 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.343372 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.343700 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.344009 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.344320 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.344633 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.344945 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.345253 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.345568 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.345882 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.346204 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.346527 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.346833 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.347174 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.347501 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.347845 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.348158 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.348498 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.348823 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.349134 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.349443 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.349774 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:33:25.350010 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 09:33:25.507117 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO dbcounter [None req-dfd70185-aa9e-429a-80ad-8c2a3d0c917b None None] Registered counter for database nova_api Jun 24 09:33:25.528209 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG oslo_db.sqlalchemy.engines [None req-dfd70185-aa9e-429a-80ad-8c2a3d0c917b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:33:25.537132 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG dbcounter [-] [109844] Writer thread running {{(pid=109844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:33:25.606211 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.context [None req-dfd70185-aa9e-429a-80ad-8c2a3d0c917b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f2d2cbef-ff41-499b-a255-74c93eabe11c(cell1) {{(pid=109844) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 09:33:25.610529 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG oslo_concurrency.lockutils [None req-dfd70185-aa9e-429a-80ad-8c2a3d0c917b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:33:25.612167 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG oslo_concurrency.lockutils [None req-dfd70185-aa9e-429a-80ad-8c2a3d0c917b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:33:25.612984 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG oslo_concurrency.lockutils [None req-dfd70185-aa9e-429a-80ad-8c2a3d0c917b None None] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:33:25.615016 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG oslo_concurrency.lockutils [None req-dfd70185-aa9e-429a-80ad-8c2a3d0c917b None None] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:33:25.617664 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO dbcounter [None req-dfd70185-aa9e-429a-80ad-8c2a3d0c917b None None] Registered counter for database nova_cell0 Jun 24 09:33:25.621980 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO dbcounter [None req-dfd70185-aa9e-429a-80ad-8c2a3d0c917b None None] Registered counter for database nova_cell1 Jun 24 09:33:25.631942 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG oslo_db.sqlalchemy.engines [None req-dfd70185-aa9e-429a-80ad-8c2a3d0c917b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:33:25.635516 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG oslo_db.sqlalchemy.engines [None req-dfd70185-aa9e-429a-80ad-8c2a3d0c917b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:33:25.638412 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG dbcounter [-] [109844] Writer thread running {{(pid=109844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:33:25.666424 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: WARNING keystonemiddleware.auth_token [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 09:33:25.672441 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: WARNING keystonemiddleware.auth_token [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 09:33:25.677805 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b7e3d069c0 pid: 109843 (default app) Jun 24 09:33:25.680300 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:33:25.681509 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] 10.222.0.65 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001788 Jun 24 09:33:25.681940 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 788 bytes} [Fri Jun 24 09:33:25 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:33:25.780152 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG dbcounter [-] [109844] Writer thread running {{(pid=109844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:33:25.791130 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO dbcounter [None req-dfd70185-aa9e-429a-80ad-8c2a3d0c917b None None] Registered counter for database nova_cell0 Jun 24 09:33:25.800368 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG oslo_db.sqlalchemy.engines [None req-dfd70185-aa9e-429a-80ad-8c2a3d0c917b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:33:25.807008 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG dbcounter [-] [109844] Writer thread running {{(pid=109844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:33:26.126404 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: WARNING keystonemiddleware.auth_token [None req-dfd70185-aa9e-429a-80ad-8c2a3d0c917b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 09:33:26.133898 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: WARNING keystonemiddleware.auth_token [None req-dfd70185-aa9e-429a-80ad-8c2a3d0c917b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 09:33:26.478398 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: WARNING keystonemiddleware.auth_token [None req-dfd70185-aa9e-429a-80ad-8c2a3d0c917b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 09:33:26.485407 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: WARNING keystonemiddleware.auth_token [None req-dfd70185-aa9e-429a-80ad-8c2a3d0c917b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 09:33:26.490973 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b7e3d069c0 pid: 109844 (default app) Jun 24 09:34:41.807697 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:34:41.809434 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002335 Jun 24 09:34:41.811123 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 2/2] 10.222.0.65 () {54 vars in 930 bytes} [Fri Jun 24 09:34:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:34:41.828378 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG dbcounter [-] [109844] Writing DB stats nova_api:SELECT=3 {{(pid=109844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:34:41.830229 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG dbcounter [-] [109844] Writing DB stats nova_cell0:SELECT=3 {{(pid=109844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:34:41.831321 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG dbcounter [-] [109844] Writing DB stats nova_cell1:SELECT=3 {{(pid=109844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:34:41.832372 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG dbcounter [-] [109844] Writing DB stats nova_cell0:SELECT=3 {{(pid=109844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:34:42.254886 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-a8007898-760a-49a0-8799-ab9bf892fe3a admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:34:42.288279 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-a8007898-760a-49a0-8799-ab9bf892fe3a admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.469898 Jun 24 09:34:42.289050 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 1/3] 10.222.0.65 () {60 vars in 1291 bytes} [Fri Jun 24 09:34:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:34:44.340795 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:34:44.341806 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-2eeff059-3573-4b99-b8f2-f35de835b8db None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 24 09:34:44.342195 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 3/4] 10.222.0.65 () {54 vars in 930 bytes} [Fri Jun 24 09:34:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:34:44.404056 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-5b19c6ca-e224-4280-a08e-8a16f0f424d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "disk": 1, "id": "c1"}} {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:34:44.423020 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:34:44.423020 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: warnings.warn(msg) Jun 24 09:34:44.452272 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-5b19c6ca-e224-4280-a08e-8a16f0f424d1 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103769 Jun 24 09:34:44.452923 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 2/5] 10.222.0.65 () {64 vars in 1282 bytes} [Fri Jun 24 09:34:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:34:44.686877 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-4680f092-802d-4fcb-b0aa-c6fabb88bf73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:34:44.689590 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:34:44.689590 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: warnings.warn(msg) Jun 24 09:34:44.692330 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writing DB stats nova_api:SELECT=3 {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:34:44.693232 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writing DB stats nova_cell0:SELECT=3 {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:34:44.694328 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writing DB stats nova_cell1:SELECT=3 {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:34:44.695192 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:34:44.769500 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-4680f092-802d-4fcb-b0aa-c6fabb88bf73 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.308146 Jun 24 09:34:44.770342 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 4/6] 10.222.0.65 () {64 vars in 1335 bytes} [Fri Jun 24 09:34:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:34:46.875946 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-5b19c6ca-e224-4280-a08e-8a16f0f424d1 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:34:46.877646 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-5b19c6ca-e224-4280-a08e-8a16f0f424d1 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002261 Jun 24 09:34:46.878067 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 3/7] 10.222.0.65 () {54 vars in 930 bytes} [Fri Jun 24 09:34:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:34:47.007612 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-bd47f26e-cd2f-4c83-8746-148f3b1be1f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "disk": 5, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "ds512M"}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:34:47.025080 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:34:47.025080 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: warnings.warn(msg) Jun 24 09:34:47.045172 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-bd47f26e-cd2f-4c83-8746-148f3b1be1f0 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.160428 Jun 24 09:34:47.045945 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 5/8] 10.222.0.65 () {64 vars in 1282 bytes} [Fri Jun 24 09:34:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:34:47.058077 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-f664bff3-6de6-45ba-98fe-24f8d8f7fb84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:34:47.059624 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:34:47.059624 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: warnings.warn(msg) Jun 24 09:34:47.090844 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-f664bff3-6de6-45ba-98fe-24f8d8f7fb84 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036468 Jun 24 09:34:47.091367 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 4/9] 10.222.0.65 () {64 vars in 1335 bytes} [Fri Jun 24 09:34:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:34:49.186637 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-bd47f26e-cd2f-4c83-8746-148f3b1be1f0 admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:34:49.188366 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-bd47f26e-cd2f-4c83-8746-148f3b1be1f0 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002162 Jun 24 09:34:49.189350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 6/10] 10.222.0.65 () {54 vars in 930 bytes} [Fri Jun 24 09:34:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:34:49.270662 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-2fbe6782-962f-4d8c-8c24-2f2936a216f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 1024, "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:34:49.293400 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-2fbe6782-962f-4d8c-8c24-2f2936a216f4 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.097928 Jun 24 09:34:49.294072 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 5/11] 10.222.0.65 () {64 vars in 1282 bytes} [Fri Jun 24 09:34:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 09:34:49.308062 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-99bf8cc4-7eac-4585-aba2-97398194f7bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:34:49.337133 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-99bf8cc4-7eac-4585-aba2-97398194f7bc admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033593 Jun 24 09:34:49.343103 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 7/12] 10.222.0.65 () {64 vars in 1335 bytes} [Fri Jun 24 09:34:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:34:51.435052 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-2fbe6782-962f-4d8c-8c24-2f2936a216f4 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:34:51.436243 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-2fbe6782-962f-4d8c-8c24-2f2936a216f4 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001639 Jun 24 09:34:51.436937 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 6/13] 10.222.0.65 () {54 vars in 930 bytes} [Fri Jun 24 09:34:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:34:51.499249 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-47848ad5-ff61-41d0-91c1-3816479fb085 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "id": "d3", "name": "ds2G", "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:34:51.519259 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-47848ad5-ff61-41d0-91c1-3816479fb085 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076173 Jun 24 09:34:51.519798 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 8/14] 10.222.0.65 () {64 vars in 1282 bytes} [Fri Jun 24 09:34:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:34:51.531786 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-0bbf481c-8ec1-48c0-9d94-67139bbec1cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:34:51.554288 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-0bbf481c-8ec1-48c0-9d94-67139bbec1cd admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026171 Jun 24 09:34:51.554956 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 7/15] 10.222.0.65 () {64 vars in 1335 bytes} [Fri Jun 24 09:34:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:34:53.637456 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-47848ad5-ff61-41d0-91c1-3816479fb085 admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:34:53.638402 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-47848ad5-ff61-41d0-91c1-3816479fb085 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jun 24 09:34:53.638798 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 9/16] 10.222.0.65 () {54 vars in 930 bytes} [Fri Jun 24 09:34:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:34:53.697342 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-f79bfaf0-8f2e-4bed-acb2-2f86e2cf65e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 20, "name": "ds4G", "id": "d4", "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:34:53.715317 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-f79bfaf0-8f2e-4bed-acb2-2f86e2cf65e8 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070525 Jun 24 09:34:53.716085 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 8/17] 10.222.0.65 () {64 vars in 1282 bytes} [Fri Jun 24 09:34:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:34:53.727793 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-96891a48-3d69-40d5-883d-0385ac8d48b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:34:53.753445 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-96891a48-3d69-40d5-883d-0385ac8d48b1 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029373 Jun 24 09:34:53.754022 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 10/18] 10.222.0.65 () {64 vars in 1335 bytes} [Fri Jun 24 09:34:53 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:34:55.846805 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-f79bfaf0-8f2e-4bed-acb2-2f86e2cf65e8 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:34:55.848801 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-f79bfaf0-8f2e-4bed-acb2-2f86e2cf65e8 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002404 Jun 24 09:34:55.849205 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 9/19] 10.222.0.65 () {54 vars in 930 bytes} [Fri Jun 24 09:34:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:34:55.912166 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-3723c88e-6820-4c58-9679-9e8249609d7f admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:34:55.937191 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-3723c88e-6820-4c58-9679-9e8249609d7f admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081536 Jun 24 09:34:55.937752 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 11/20] 10.222.0.65 () {60 vars in 1291 bytes} [Fri Jun 24 09:34:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:34:58.024131 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-f79bfaf0-8f2e-4bed-acb2-2f86e2cf65e8 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:34:58.024903 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-f79bfaf0-8f2e-4bed-acb2-2f86e2cf65e8 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 24 09:34:58.029069 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 10/21] 10.222.0.65 () {54 vars in 930 bytes} [Fri Jun 24 09:34:58 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:34:58.087803 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-905e6171-05b5-455f-99bd-43a250deefbc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:34:58.108905 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-905e6171-05b5-455f-99bd-43a250deefbc admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078295 Jun 24 09:34:58.109459 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 12/22] 10.222.0.65 () {64 vars in 1282 bytes} [Fri Jun 24 09:34:58 2022] POST /compute/v2.1/flavors => generated 402 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 09:34:58.123566 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-158f70c7-6f94-4bc4-8004-d57df0d74d9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:34:58.149232 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-158f70c7-6f94-4bc4-8004-d57df0d74d9a admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029201 Jun 24 09:34:58.149895 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 11/23] 10.222.0.65 () {64 vars in 1332 bytes} [Fri Jun 24 09:34:58 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:35:00.323853 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-905e6171-05b5-455f-99bd-43a250deefbc admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:00.325034 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-905e6171-05b5-455f-99bd-43a250deefbc admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001708 Jun 24 09:35:00.325492 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 13/24] 10.222.0.65 () {54 vars in 930 bytes} [Fri Jun 24 09:35:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:35:00.404172 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-fed0cf4c-ce4b-4820-a1d6-ebce15e2abe8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 1, "disk": 20, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:35:00.428952 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-fed0cf4c-ce4b-4820-a1d6-ebce15e2abe8 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.096699 Jun 24 09:35:00.429769 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 12/25] 10.222.0.65 () {64 vars in 1282 bytes} [Fri Jun 24 09:35:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:35:00.443816 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-7e3a893f-57c8-43ed-94e5-f0b83ff4521e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:35:00.473479 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-7e3a893f-57c8-43ed-94e5-f0b83ff4521e admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034605 Jun 24 09:35:00.474343 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 14/26] 10.222.0.65 () {64 vars in 1332 bytes} [Fri Jun 24 09:35:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:35:02.845108 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-fed0cf4c-ce4b-4820-a1d6-ebce15e2abe8 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:02.846425 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-fed0cf4c-ce4b-4820-a1d6-ebce15e2abe8 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001763 Jun 24 09:35:02.846837 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 13/27] 10.222.0.65 () {54 vars in 930 bytes} [Fri Jun 24 09:35:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:35:02.926668 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-eec03640-084c-4809-a367-19f71520e48d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "disk": 40, "name": "m1.medium", "id": "3", "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:35:02.949759 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-eec03640-084c-4809-a367-19f71520e48d admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.095168 Jun 24 09:35:02.950506 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 15/28] 10.222.0.65 () {64 vars in 1282 bytes} [Fri Jun 24 09:35:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 09:35:02.963614 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-db3f4291-4c08-49bf-9ee4-8bda9f331064 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:35:02.988539 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-db3f4291-4c08-49bf-9ee4-8bda9f331064 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028798 Jun 24 09:35:02.989191 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 14/29] 10.222.0.65 () {64 vars in 1332 bytes} [Fri Jun 24 09:35:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:35:05.126550 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-eec03640-084c-4809-a367-19f71520e48d admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:05.127745 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-eec03640-084c-4809-a367-19f71520e48d admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 Jun 24 09:35:05.128223 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 16/30] 10.222.0.65 () {54 vars in 930 bytes} [Fri Jun 24 09:35:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:35:05.188688 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-e8cb61e3-870f-4f96-8f30-db9d729c5e96 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.large", "id": "4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 80, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:35:05.207502 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-e8cb61e3-870f-4f96-8f30-db9d729c5e96 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073348 Jun 24 09:35:05.215128 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 15/31] 10.222.0.65 () {64 vars in 1282 bytes} [Fri Jun 24 09:35:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:35:05.220427 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-15a7d6ea-4d2b-44b2-b5b6-a19ec373b418 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:35:05.244292 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-15a7d6ea-4d2b-44b2-b5b6-a19ec373b418 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027831 Jun 24 09:35:05.244872 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 17/32] 10.222.0.65 () {64 vars in 1332 bytes} [Fri Jun 24 09:35:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:35:07.319673 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-e8cb61e3-870f-4f96-8f30-db9d729c5e96 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:07.321607 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-e8cb61e3-870f-4f96-8f30-db9d729c5e96 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001693 Jun 24 09:35:07.322012 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 16/33] 10.222.0.65 () {54 vars in 930 bytes} [Fri Jun 24 09:35:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:35:07.392563 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-03d6e739-8b47-4a42-8f5e-f6306f181593 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:35:07.412610 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-03d6e739-8b47-4a42-8f5e-f6306f181593 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.084141 Jun 24 09:35:07.413158 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 18/34] 10.222.0.65 () {64 vars in 1282 bytes} [Fri Jun 24 09:35:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:35:07.426895 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-0df5d583-e034-44f3-8744-92030a40cc40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:35:07.455170 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-0df5d583-e034-44f3-8744-92030a40cc40 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032682 Jun 24 09:35:07.455925 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 17/35] 10.222.0.65 () {64 vars in 1332 bytes} [Fri Jun 24 09:35:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:35:32.072664 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-03d6e739-8b47-4a42-8f5e-f6306f181593 admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:32.073997 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-03d6e739-8b47-4a42-8f5e-f6306f181593 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003082 Jun 24 09:35:32.074539 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 19/36] 10.222.0.65 () {54 vars in 930 bytes} [Fri Jun 24 09:35:32 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:35:32.087210 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG dbcounter [-] [109844] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:35:32.142479 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-c6c93f34-b5ed-4eb0-81e5-87c6b66c2304 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:32.159487 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-c6c93f34-b5ed-4eb0-81e5-87c6b66c2304 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.076985 Jun 24 09:35:32.160021 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 18/37] 10.222.0.65 () {60 vars in 1291 bytes} [Fri Jun 24 09:35:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:35:33.109256 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-03d6e739-8b47-4a42-8f5e-f6306f181593 admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:33.110342 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-03d6e739-8b47-4a42-8f5e-f6306f181593 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jun 24 09:35:33.110736 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 20/38] 10.222.0.65 () {56 vars in 1074 bytes} [Fri Jun 24 09:35:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:35:33.307349 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-a1f00c8c-e9b0-4c05-a19e-4a87e6f26317 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:33.313636 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.wsgi [None req-a1f00c8c-e9b0-4c05-a19e-4a87e6f26317 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 09:35:33.317114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-a1f00c8c-e9b0-4c05-a19e-4a87e6f26317 admin admin] Request method failure captured: Jun 24 09:35:33.317114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 24 09:35:33.317114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Accept: application/json Jun 24 09:35:33.317114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Accept-Encoding: gzip, deflate Jun 24 09:35:33.317114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Connection: keep-alive Jun 24 09:35:33.317114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Content-Length: 0 Jun 24 09:35:33.317114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Host: 10.222.0.65 Jun 24 09:35:33.317114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Openstack-Api-Version: compute 2.90 Jun 24 09:35:33.317114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Openstack-System-Scope: None Jun 24 09:35:33.317114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: User-Agent: python-novaclient Jun 24 09:35:33.317114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Auth-Token: gAAAAABitYVl3JAF_iAsfedheW8vI-CCLMKqHqW0BTnZ_khkvc9-h2nYTS5GljLjN0EEP27qgntSK1v-KjFSJ1ZFCEh8TbIHwTxlFTwB8hzBgsNV8lrFgEAAsuN89sKzV7_i0vDbqIqhXfC9p1O39mkU_6prGtAhv-FDRaBwrK5Q_y7M4BH6FsE Jun 24 09:35:33.317114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Domain-Id: None Jun 24 09:35:33.317114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Domain-Name: None Jun 24 09:35:33.317114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Identity-Status: Confirmed Jun 24 09:35:33.317114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Is-Admin-Project: True Jun 24 09:35:33.317114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 09:35:33.317114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Project-Domain-Id: default Jun 24 09:35:33.317114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Project-Domain-Name: Default Jun 24 09:35:33.317114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Project-Id: 46a0c5caeb0244aaa5e89844285d900b Jun 24 09:35:33.317114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Project-Name: admin Jun 24 09:35:33.317114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Role: reader,admin,member Jun 24 09:35:33.317114 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Roles: reader,admin,member Jun 24 09:35:33.318747 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_46a0c5caeb0244aaa5e89844285d900b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/46a0c5caeb0244aaa5e89844285d900b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/46a0c5caeb0244aaa5e89844285d900b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/46a0c5caeb0244aaa5e89844285d900b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:35:33.318747 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Tenant: admin Jun 24 09:35:33.318747 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Tenant-Id: 46a0c5caeb0244aaa5e89844285d900b Jun 24 09:35:33.318747 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Tenant-Name: admin Jun 24 09:35:33.318747 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-User: admin Jun 24 09:35:33.318747 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-User-Domain-Id: default Jun 24 09:35:33.318747 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-User-Domain-Name: Default Jun 24 09:35:33.318747 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-User-Id: 0fdc8f07afea4aa1a81df36db46bb225 Jun 24 09:35:33.318747 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-User-Name: admin Jun 24 09:35:33.318747 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: method: > Jun 24 09:35:33.318747 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: exception: Flavor 42 could not be found. Jun 24 09:35:33.318747 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: action_args: {'id': '42'} Jun 24 09:35:33.318747 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:35:33.318747 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:35:33.319789 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 09:35:33.319789 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 09:35:33.319789 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 09:35:33.319789 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 09:35:33.319789 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 09:35:33.319789 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 09:35:33.319789 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 09:35:33.319789 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 09:35:33.319789 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 09:35:33.319789 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:35:33.319789 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 09:35:33.319789 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 09:35:33.319789 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 24 09:35:33.319789 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Jun 24 09:35:33.319789 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:35:33.319789 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Jun 24 09:35:33.319789 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:35:33.319789 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:35:33.319789 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:35:33.320942 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:35:33.320942 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:35:33.320942 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:35:33.320942 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:35:33.320942 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 09:35:33.320942 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:35:33.320942 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 24 09:35:33.320942 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Jun 24 09:35:33.320942 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:35:33.320942 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Jun 24 09:35:33.320942 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:35:33.320942 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:35:33.320942 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:35:33.320942 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:35:33.320942 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:35:33.320942 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 24 09:35:33.320942 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Jun 24 09:35:33.320942 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-a1f00c8c-e9b0-4c05-a19e-4a87e6f26317 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:35:33.321990 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-a1f00c8c-e9b0-4c05-a19e-4a87e6f26317 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.072651 Jun 24 09:35:33.321990 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 19/39] 10.222.0.65 () {60 vars in 1190 bytes} [Fri Jun 24 09:35:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 09:35:33.328527 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-a338f1f3-29e9-4daa-88bf-0a0fa60803c9 admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:33.331517 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:35:33.351180 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-a338f1f3-29e9-4daa-88bf-0a0fa60803c9 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026264 Jun 24 09:35:33.351717 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 21/40] 10.222.0.65 () {60 vars in 1210 bytes} [Fri Jun 24 09:35:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:35:33.362993 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-91473c72-4ef6-4bc0-b329-e8b42968cc09 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:33.384686 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-91473c72-4ef6-4bc0-b329-e8b42968cc09 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026078 Jun 24 09:35:33.385247 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 20/41] 10.222.0.65 () {60 vars in 1210 bytes} [Fri Jun 24 09:35:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:35:33.406284 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-cfeea031-bce0-4a40-85d3-9e5cfa87a5f6 admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:33.413694 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.wsgi [None req-cfeea031-bce0-4a40-85d3-9e5cfa87a5f6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 09:35:33.417126 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-cfeea031-bce0-4a40-85d3-9e5cfa87a5f6 admin admin] Request method failure captured: Jun 24 09:35:33.417126 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 24 09:35:33.417126 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Accept: application/json Jun 24 09:35:33.417126 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Accept-Encoding: gzip, deflate Jun 24 09:35:33.417126 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Connection: keep-alive Jun 24 09:35:33.417126 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Content-Length: 0 Jun 24 09:35:33.417126 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Host: 10.222.0.65 Jun 24 09:35:33.417126 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Openstack-Api-Version: compute 2.90 Jun 24 09:35:33.417126 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Openstack-System-Scope: None Jun 24 09:35:33.417126 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: User-Agent: python-novaclient Jun 24 09:35:33.417126 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Auth-Token: gAAAAABitYVl3JAF_iAsfedheW8vI-CCLMKqHqW0BTnZ_khkvc9-h2nYTS5GljLjN0EEP27qgntSK1v-KjFSJ1ZFCEh8TbIHwTxlFTwB8hzBgsNV8lrFgEAAsuN89sKzV7_i0vDbqIqhXfC9p1O39mkU_6prGtAhv-FDRaBwrK5Q_y7M4BH6FsE Jun 24 09:35:33.417126 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Domain-Id: None Jun 24 09:35:33.417126 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Domain-Name: None Jun 24 09:35:33.417126 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Identity-Status: Confirmed Jun 24 09:35:33.417126 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Is-Admin-Project: True Jun 24 09:35:33.417126 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 09:35:33.417126 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Project-Domain-Id: default Jun 24 09:35:33.417126 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Project-Domain-Name: Default Jun 24 09:35:33.417126 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Project-Id: 46a0c5caeb0244aaa5e89844285d900b Jun 24 09:35:33.417126 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Project-Name: admin Jun 24 09:35:33.417126 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Role: reader,admin,member Jun 24 09:35:33.417126 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Roles: reader,admin,member Jun 24 09:35:33.418601 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_46a0c5caeb0244aaa5e89844285d900b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/46a0c5caeb0244aaa5e89844285d900b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/46a0c5caeb0244aaa5e89844285d900b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/46a0c5caeb0244aaa5e89844285d900b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:35:33.418601 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Tenant: admin Jun 24 09:35:33.418601 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Tenant-Id: 46a0c5caeb0244aaa5e89844285d900b Jun 24 09:35:33.418601 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Tenant-Name: admin Jun 24 09:35:33.418601 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-User: admin Jun 24 09:35:33.418601 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-User-Domain-Id: default Jun 24 09:35:33.418601 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-User-Domain-Name: Default Jun 24 09:35:33.418601 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-User-Id: 0fdc8f07afea4aa1a81df36db46bb225 Jun 24 09:35:33.418601 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-User-Name: admin Jun 24 09:35:33.418601 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: method: > Jun 24 09:35:33.418601 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: exception: Flavor 42 could not be found. Jun 24 09:35:33.418601 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: action_args: {'id': '42'} Jun 24 09:35:33.418601 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:35:33.418601 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:35:33.419680 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 09:35:33.419680 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 09:35:33.419680 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 09:35:33.419680 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 09:35:33.419680 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 09:35:33.419680 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 09:35:33.419680 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 09:35:33.419680 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 09:35:33.419680 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 09:35:33.419680 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:35:33.419680 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 09:35:33.419680 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 09:35:33.419680 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 24 09:35:33.419680 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 24 09:35:33.419680 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:35:33.419680 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 24 09:35:33.419680 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:35:33.419680 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:35:33.419680 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:35:33.420947 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:35:33.420947 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:35:33.420947 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:35:33.420947 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:35:33.420947 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 09:35:33.420947 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:35:33.420947 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 24 09:35:33.420947 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 24 09:35:33.420947 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:35:33.420947 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 24 09:35:33.420947 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:35:33.420947 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:35:33.420947 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:35:33.420947 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:35:33.420947 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:35:33.420947 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 24 09:35:33.420947 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 24 09:35:33.420947 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-cfeea031-bce0-4a40-85d3-9e5cfa87a5f6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:35:33.421938 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-cfeea031-bce0-4a40-85d3-9e5cfa87a5f6 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016043 Jun 24 09:35:33.421938 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 22/42] 10.222.0.65 () {60 vars in 1190 bytes} [Fri Jun 24 09:35:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 24 09:35:34.257539 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-91473c72-4ef6-4bc0-b329-e8b42968cc09 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:34.258558 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-91473c72-4ef6-4bc0-b329-e8b42968cc09 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 24 09:35:34.258947 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 21/43] 10.222.0.65 () {56 vars in 1074 bytes} [Fri Jun 24 09:35:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:35:34.470070 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-641d4f3b-3a28-46ab-a9aa-b41ddab282b0 admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:34.476610 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.wsgi [None req-641d4f3b-3a28-46ab-a9aa-b41ddab282b0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 09:35:34.478350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-641d4f3b-3a28-46ab-a9aa-b41ddab282b0 admin admin] Request method failure captured: Jun 24 09:35:34.478350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 24 09:35:34.478350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Accept: application/json Jun 24 09:35:34.478350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Accept-Encoding: gzip, deflate Jun 24 09:35:34.478350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Connection: keep-alive Jun 24 09:35:34.478350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Content-Length: 0 Jun 24 09:35:34.478350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Host: 10.222.0.65 Jun 24 09:35:34.478350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Openstack-Api-Version: compute 2.90 Jun 24 09:35:34.478350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Openstack-System-Scope: None Jun 24 09:35:34.478350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: User-Agent: python-novaclient Jun 24 09:35:34.478350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Auth-Token: gAAAAABitYVmO5xBBb86aiV5irqo_N2XtlP7XmSXP7JLPVuH_SoodOfgh1mELtBk2bYwPeJc9fZZUzs9jJsIIeGMlJ9Fr119rBgS95DnxMfrTrvImMHrZRABm3vKAeB9C5GLrIw2jhmMv2kdb6WXXqOFqWdce_DADtTr_OWURYi7oWpcXLWdgUI Jun 24 09:35:34.478350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Domain-Id: None Jun 24 09:35:34.478350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Domain-Name: None Jun 24 09:35:34.478350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Identity-Status: Confirmed Jun 24 09:35:34.478350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Is-Admin-Project: True Jun 24 09:35:34.478350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 09:35:34.478350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Project-Domain-Id: default Jun 24 09:35:34.478350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Project-Domain-Name: Default Jun 24 09:35:34.478350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Project-Id: 46a0c5caeb0244aaa5e89844285d900b Jun 24 09:35:34.478350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Project-Name: admin Jun 24 09:35:34.478350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Role: reader,admin,member Jun 24 09:35:34.478350 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Roles: reader,admin,member Jun 24 09:35:34.480052 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_46a0c5caeb0244aaa5e89844285d900b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/46a0c5caeb0244aaa5e89844285d900b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/46a0c5caeb0244aaa5e89844285d900b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/46a0c5caeb0244aaa5e89844285d900b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:35:34.480052 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Tenant: admin Jun 24 09:35:34.480052 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Tenant-Id: 46a0c5caeb0244aaa5e89844285d900b Jun 24 09:35:34.480052 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Tenant-Name: admin Jun 24 09:35:34.480052 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-User: admin Jun 24 09:35:34.480052 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-User-Domain-Id: default Jun 24 09:35:34.480052 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-User-Domain-Name: Default Jun 24 09:35:34.480052 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-User-Id: 0fdc8f07afea4aa1a81df36db46bb225 Jun 24 09:35:34.480052 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-User-Name: admin Jun 24 09:35:34.480052 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: method: > Jun 24 09:35:34.480052 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: exception: Flavor 84 could not be found. Jun 24 09:35:34.480052 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: action_args: {'id': '84'} Jun 24 09:35:34.480052 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:35:34.480052 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:35:34.480911 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 09:35:34.480911 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 09:35:34.480911 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 09:35:34.480911 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 09:35:34.480911 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 09:35:34.480911 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 09:35:34.480911 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 09:35:34.480911 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 09:35:34.480911 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 09:35:34.480911 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:35:34.480911 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 09:35:34.480911 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 09:35:34.480911 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 24 09:35:34.480911 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 24 09:35:34.480911 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:35:34.480911 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 24 09:35:34.480911 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:35:34.480911 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:35:34.480911 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:35:34.481969 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:35:34.481969 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:35:34.481969 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:35:34.481969 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:35:34.481969 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 09:35:34.481969 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:35:34.481969 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 24 09:35:34.481969 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 24 09:35:34.481969 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:35:34.481969 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 24 09:35:34.481969 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:35:34.481969 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:35:34.481969 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:35:34.481969 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:35:34.481969 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:35:34.481969 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 24 09:35:34.481969 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 24 09:35:34.481969 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-641d4f3b-3a28-46ab-a9aa-b41ddab282b0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:35:34.483043 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-641d4f3b-3a28-46ab-a9aa-b41ddab282b0 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.082881 Jun 24 09:35:34.483043 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 23/44] 10.222.0.65 () {60 vars in 1190 bytes} [Fri Jun 24 09:35:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 09:35:34.492186 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-cdcd1ff2-bcd9-471c-a26f-cfaaea02db9a admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:34.508602 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-cdcd1ff2-bcd9-471c-a26f-cfaaea02db9a admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020041 Jun 24 09:35:34.509167 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 22/45] 10.222.0.65 () {60 vars in 1210 bytes} [Fri Jun 24 09:35:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:35:34.524333 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-6902ce25-5abe-4456-a495-2583e30ee598 admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:34.542858 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-6902ce25-5abe-4456-a495-2583e30ee598 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024311 Jun 24 09:35:34.543414 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 24/46] 10.222.0.65 () {60 vars in 1210 bytes} [Fri Jun 24 09:35:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:35:34.553303 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-c782b50c-652e-420e-8483-c4fa0eb33308 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:34.558860 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.wsgi [None req-c782b50c-652e-420e-8483-c4fa0eb33308 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 09:35:34.560417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-c782b50c-652e-420e-8483-c4fa0eb33308 admin admin] Request method failure captured: Jun 24 09:35:34.560417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 24 09:35:34.560417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Accept: application/json Jun 24 09:35:34.560417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Accept-Encoding: gzip, deflate Jun 24 09:35:34.560417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Connection: keep-alive Jun 24 09:35:34.560417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Content-Length: 0 Jun 24 09:35:34.560417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Host: 10.222.0.65 Jun 24 09:35:34.560417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Openstack-Api-Version: compute 2.90 Jun 24 09:35:34.560417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Openstack-System-Scope: None Jun 24 09:35:34.560417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: User-Agent: python-novaclient Jun 24 09:35:34.560417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Auth-Token: gAAAAABitYVmO5xBBb86aiV5irqo_N2XtlP7XmSXP7JLPVuH_SoodOfgh1mELtBk2bYwPeJc9fZZUzs9jJsIIeGMlJ9Fr119rBgS95DnxMfrTrvImMHrZRABm3vKAeB9C5GLrIw2jhmMv2kdb6WXXqOFqWdce_DADtTr_OWURYi7oWpcXLWdgUI Jun 24 09:35:34.560417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Domain-Id: None Jun 24 09:35:34.560417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Domain-Name: None Jun 24 09:35:34.560417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Identity-Status: Confirmed Jun 24 09:35:34.560417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Is-Admin-Project: True Jun 24 09:35:34.560417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 09:35:34.560417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Project-Domain-Id: default Jun 24 09:35:34.560417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Project-Domain-Name: Default Jun 24 09:35:34.560417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Project-Id: 46a0c5caeb0244aaa5e89844285d900b Jun 24 09:35:34.560417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Project-Name: admin Jun 24 09:35:34.560417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Role: reader,admin,member Jun 24 09:35:34.560417 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Roles: reader,admin,member Jun 24 09:35:34.561755 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_46a0c5caeb0244aaa5e89844285d900b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/46a0c5caeb0244aaa5e89844285d900b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/46a0c5caeb0244aaa5e89844285d900b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/46a0c5caeb0244aaa5e89844285d900b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:35:34.561755 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Tenant: admin Jun 24 09:35:34.561755 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Tenant-Id: 46a0c5caeb0244aaa5e89844285d900b Jun 24 09:35:34.561755 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Tenant-Name: admin Jun 24 09:35:34.561755 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-User: admin Jun 24 09:35:34.561755 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-User-Domain-Id: default Jun 24 09:35:34.561755 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-User-Domain-Name: Default Jun 24 09:35:34.561755 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-User-Id: 0fdc8f07afea4aa1a81df36db46bb225 Jun 24 09:35:34.561755 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-User-Name: admin Jun 24 09:35:34.561755 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: method: > Jun 24 09:35:34.561755 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: exception: Flavor 84 could not be found. Jun 24 09:35:34.561755 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: action_args: {'id': '84'} Jun 24 09:35:34.561755 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:35:34.561755 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:35:34.562531 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 09:35:34.562531 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 09:35:34.562531 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 09:35:34.562531 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 09:35:34.562531 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 09:35:34.562531 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 09:35:34.562531 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 09:35:34.562531 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 09:35:34.562531 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 09:35:34.562531 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:35:34.562531 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 09:35:34.562531 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 09:35:34.562531 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 24 09:35:34.562531 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Jun 24 09:35:34.562531 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:35:34.562531 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Jun 24 09:35:34.562531 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:35:34.562531 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:35:34.562531 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:35:34.563803 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:35:34.563803 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:35:34.563803 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:35:34.563803 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:35:34.563803 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 09:35:34.563803 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:35:34.563803 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 24 09:35:34.563803 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Jun 24 09:35:34.563803 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:35:34.563803 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Jun 24 09:35:34.563803 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:35:34.563803 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:35:34.563803 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:35:34.563803 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:35:34.563803 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:35:34.563803 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 24 09:35:34.563803 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Jun 24 09:35:34.563803 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-c782b50c-652e-420e-8483-c4fa0eb33308 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:35:34.564955 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-c782b50c-652e-420e-8483-c4fa0eb33308 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012154 Jun 24 09:35:34.564955 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 23/47] 10.222.0.65 () {60 vars in 1190 bytes} [Fri Jun 24 09:35:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 09:35:35.407720 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-6902ce25-5abe-4456-a495-2583e30ee598 admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:35.409265 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-6902ce25-5abe-4456-a495-2583e30ee598 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002187 Jun 24 09:35:35.409810 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 25/48] 10.222.0.65 () {56 vars in 1074 bytes} [Fri Jun 24 09:35:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:35:35.622305 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-ddeb974d-9b36-422b-bf9f-0f7c4e6a0bb2 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:35.629552 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.wsgi [None req-ddeb974d-9b36-422b-bf9f-0f7c4e6a0bb2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 09:35:35.631188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-ddeb974d-9b36-422b-bf9f-0f7c4e6a0bb2 admin admin] Request method failure captured: Jun 24 09:35:35.631188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 24 09:35:35.631188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Accept: application/json Jun 24 09:35:35.631188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Accept-Encoding: gzip, deflate Jun 24 09:35:35.631188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Connection: keep-alive Jun 24 09:35:35.631188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Content-Length: 0 Jun 24 09:35:35.631188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Host: 10.222.0.65 Jun 24 09:35:35.631188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Openstack-Api-Version: compute 2.90 Jun 24 09:35:35.631188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Openstack-System-Scope: None Jun 24 09:35:35.631188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: User-Agent: python-novaclient Jun 24 09:35:35.631188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Auth-Token: gAAAAABitYVn-YohdpwkkbjSzs2i8_oNyg0rAo8XfRq5yt4Uv3sfNFMYaeuOsbxNJHPt1JvRnhqeaAeWSL0-dOND2GVy5R0ttZ17XaF2SWLHR1TnEVjUyxzTeUbzdCmVPRaIEi26dVc7jvzf7iZtXX9njGebKFPkyACO_KnRjHJSZSOmslkZv3Q Jun 24 09:35:35.631188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Domain-Id: None Jun 24 09:35:35.631188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Domain-Name: None Jun 24 09:35:35.631188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Identity-Status: Confirmed Jun 24 09:35:35.631188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Is-Admin-Project: True Jun 24 09:35:35.631188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 09:35:35.631188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Project-Domain-Id: default Jun 24 09:35:35.631188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Project-Domain-Name: Default Jun 24 09:35:35.631188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Project-Id: 46a0c5caeb0244aaa5e89844285d900b Jun 24 09:35:35.631188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Project-Name: admin Jun 24 09:35:35.631188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Role: reader,admin,member Jun 24 09:35:35.631188 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Roles: reader,admin,member Jun 24 09:35:35.632701 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_46a0c5caeb0244aaa5e89844285d900b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/46a0c5caeb0244aaa5e89844285d900b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/46a0c5caeb0244aaa5e89844285d900b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/46a0c5caeb0244aaa5e89844285d900b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:35:35.632701 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Tenant: admin Jun 24 09:35:35.632701 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Tenant-Id: 46a0c5caeb0244aaa5e89844285d900b Jun 24 09:35:35.632701 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-Tenant-Name: admin Jun 24 09:35:35.632701 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-User: admin Jun 24 09:35:35.632701 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-User-Domain-Id: default Jun 24 09:35:35.632701 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-User-Domain-Name: Default Jun 24 09:35:35.632701 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-User-Id: 0fdc8f07afea4aa1a81df36db46bb225 Jun 24 09:35:35.632701 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: X-User-Name: admin Jun 24 09:35:35.632701 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: method: > Jun 24 09:35:35.632701 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: exception: Flavor 451 could not be found. Jun 24 09:35:35.632701 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: action_args: {'id': '451'} Jun 24 09:35:35.632701 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:35:35.632701 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:35:35.633582 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 09:35:35.633582 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 09:35:35.633582 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 09:35:35.633582 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 09:35:35.633582 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 09:35:35.633582 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 09:35:35.633582 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 09:35:35.633582 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 09:35:35.633582 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 09:35:35.633582 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:35:35.633582 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 09:35:35.633582 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 09:35:35.633582 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 24 09:35:35.633582 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Jun 24 09:35:35.633582 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:35:35.633582 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Jun 24 09:35:35.633582 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:35:35.633582 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:35:35.633582 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:35:35.634610 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:35:35.634610 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:35:35.634610 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:35:35.634610 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:35:35.634610 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 09:35:35.634610 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:35:35.634610 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 24 09:35:35.634610 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Jun 24 09:35:35.634610 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:35:35.634610 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Jun 24 09:35:35.634610 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:35:35.634610 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:35:35.634610 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:35:35.634610 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:35:35.634610 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:35:35.634610 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 24 09:35:35.634610 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Jun 24 09:35:35.634610 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-ddeb974d-9b36-422b-bf9f-0f7c4e6a0bb2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:35:35.635637 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-ddeb974d-9b36-422b-bf9f-0f7c4e6a0bb2 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.075899 Jun 24 09:35:35.635637 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 24/49] 10.222.0.65 () {60 vars in 1193 bytes} [Fri Jun 24 09:35:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 09:35:35.642852 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-ca13f4d3-d524-481e-8cab-9120a7c1457e admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:35.657255 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-ca13f4d3-d524-481e-8cab-9120a7c1457e admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018164 Jun 24 09:35:35.657791 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 26/50] 10.222.0.65 () {60 vars in 1210 bytes} [Fri Jun 24 09:35:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:35:35.669433 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-c4f44202-54a3-43ec-bf28-efa9a407fa05 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:35.684522 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-c4f44202-54a3-43ec-bf28-efa9a407fa05 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020425 Jun 24 09:35:35.685050 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 25/51] 10.222.0.65 () {60 vars in 1210 bytes} [Fri Jun 24 09:35:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:35:35.694563 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-e31a0b32-0054-44f3-98f7-6631c730d58f admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:35.700029 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.wsgi [None req-e31a0b32-0054-44f3-98f7-6631c730d58f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 09:35:35.701501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-e31a0b32-0054-44f3-98f7-6631c730d58f admin admin] Request method failure captured: Jun 24 09:35:35.701501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 24 09:35:35.701501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Accept: application/json Jun 24 09:35:35.701501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Accept-Encoding: gzip, deflate Jun 24 09:35:35.701501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Connection: keep-alive Jun 24 09:35:35.701501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Content-Length: 0 Jun 24 09:35:35.701501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Host: 10.222.0.65 Jun 24 09:35:35.701501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Openstack-Api-Version: compute 2.90 Jun 24 09:35:35.701501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Openstack-System-Scope: None Jun 24 09:35:35.701501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: User-Agent: python-novaclient Jun 24 09:35:35.701501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Auth-Token: gAAAAABitYVn-YohdpwkkbjSzs2i8_oNyg0rAo8XfRq5yt4Uv3sfNFMYaeuOsbxNJHPt1JvRnhqeaAeWSL0-dOND2GVy5R0ttZ17XaF2SWLHR1TnEVjUyxzTeUbzdCmVPRaIEi26dVc7jvzf7iZtXX9njGebKFPkyACO_KnRjHJSZSOmslkZv3Q Jun 24 09:35:35.701501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Domain-Id: None Jun 24 09:35:35.701501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Domain-Name: None Jun 24 09:35:35.701501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Identity-Status: Confirmed Jun 24 09:35:35.701501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Is-Admin-Project: True Jun 24 09:35:35.701501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 09:35:35.701501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Project-Domain-Id: default Jun 24 09:35:35.701501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Project-Domain-Name: Default Jun 24 09:35:35.701501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Project-Id: 46a0c5caeb0244aaa5e89844285d900b Jun 24 09:35:35.701501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Project-Name: admin Jun 24 09:35:35.701501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Role: reader,admin,member Jun 24 09:35:35.701501 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Roles: reader,admin,member Jun 24 09:35:35.702892 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_46a0c5caeb0244aaa5e89844285d900b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/46a0c5caeb0244aaa5e89844285d900b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/46a0c5caeb0244aaa5e89844285d900b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/46a0c5caeb0244aaa5e89844285d900b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:35:35.702892 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Tenant: admin Jun 24 09:35:35.702892 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Tenant-Id: 46a0c5caeb0244aaa5e89844285d900b Jun 24 09:35:35.702892 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-Tenant-Name: admin Jun 24 09:35:35.702892 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-User: admin Jun 24 09:35:35.702892 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-User-Domain-Id: default Jun 24 09:35:35.702892 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-User-Domain-Name: Default Jun 24 09:35:35.702892 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-User-Id: 0fdc8f07afea4aa1a81df36db46bb225 Jun 24 09:35:35.702892 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: X-User-Name: admin Jun 24 09:35:35.702892 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: method: > Jun 24 09:35:35.702892 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: exception: Flavor 451 could not be found. Jun 24 09:35:35.702892 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: action_args: {'id': '451'} Jun 24 09:35:35.702892 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:35:35.702892 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:35:35.704419 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 09:35:35.704419 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 09:35:35.704419 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 09:35:35.704419 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 09:35:35.704419 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 09:35:35.704419 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 09:35:35.704419 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 09:35:35.704419 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 09:35:35.704419 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 09:35:35.704419 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:35:35.704419 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 09:35:35.704419 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 09:35:35.704419 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 24 09:35:35.704419 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 24 09:35:35.704419 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:35:35.704419 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 24 09:35:35.704419 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:35:35.704419 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:35:35.704419 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:35:35.705664 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:35:35.705664 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:35:35.705664 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:35:35.705664 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:35:35.705664 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 09:35:35.705664 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:35:35.705664 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 24 09:35:35.705664 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 24 09:35:35.705664 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:35:35.705664 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 24 09:35:35.705664 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:35:35.705664 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:35:35.705664 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:35:35.705664 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:35:35.705664 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:35:35.705664 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 24 09:35:35.705664 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 24 09:35:35.705664 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-e31a0b32-0054-44f3-98f7-6631c730d58f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:35:35.706870 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-e31a0b32-0054-44f3-98f7-6631c730d58f admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011856 Jun 24 09:35:35.706870 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 27/52] 10.222.0.65 () {60 vars in 1193 bytes} [Fri Jun 24 09:35:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 24 09:35:36.536384 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-c4f44202-54a3-43ec-bf28-efa9a407fa05 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:36.537408 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-c4f44202-54a3-43ec-bf28-efa9a407fa05 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 24 09:35:36.537805 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 26/53] 10.222.0.65 () {56 vars in 1074 bytes} [Fri Jun 24 09:35:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:35:36.733638 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-07173b1d-22e8-4a0d-90c0-f32601aeacb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:35:36.753700 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-07173b1d-22e8-4a0d-90c0-f32601aeacb5 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.078873 Jun 24 09:35:36.754255 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 28/54] 10.222.0.65 () {64 vars in 1235 bytes} [Fri Jun 24 09:35:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:35:37.612029 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-c4f44202-54a3-43ec-bf28-efa9a407fa05 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:37.613039 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-c4f44202-54a3-43ec-bf28-efa9a407fa05 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 24 09:35:37.613439 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 27/55] 10.222.0.65 () {56 vars in 1074 bytes} [Fri Jun 24 09:35:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:35:37.806259 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-de9fd76a-05d2-40fe-93b7-03d4ab6108e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:35:37.826711 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-de9fd76a-05d2-40fe-93b7-03d4ab6108e1 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.075746 Jun 24 09:35:37.827280 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 29/56] 10.222.0.65 () {64 vars in 1235 bytes} [Fri Jun 24 09:35:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:35:38.673412 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-c4f44202-54a3-43ec-bf28-efa9a407fa05 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:38.674462 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-c4f44202-54a3-43ec-bf28-efa9a407fa05 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002131 Jun 24 09:35:38.674865 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 28/57] 10.222.0.65 () {56 vars in 1074 bytes} [Fri Jun 24 09:35:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:35:38.868621 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-011a9e61-ce26-466f-ba78-c21ffa7d046c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:35:38.888992 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-011a9e61-ce26-466f-ba78-c21ffa7d046c admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.076666 Jun 24 09:35:38.889503 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 30/58] 10.222.0.65 () {64 vars in 1235 bytes} [Fri Jun 24 09:35:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:35:39.722599 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-c4f44202-54a3-43ec-bf28-efa9a407fa05 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:39.723648 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-c4f44202-54a3-43ec-bf28-efa9a407fa05 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jun 24 09:35:39.724051 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 29/59] 10.222.0.65 () {56 vars in 1074 bytes} [Fri Jun 24 09:35:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:35:39.921542 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-05f9af5a-f064-4f93-bcc4-fa6a0d209af2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:35:39.942893 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-05f9af5a-f064-4f93-bcc4-fa6a0d209af2 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.080930 Jun 24 09:35:39.943388 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 31/60] 10.222.0.65 () {64 vars in 1235 bytes} [Fri Jun 24 09:35:39 2022] POST /compute/v2.1/flavors => generated 409 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:35:40.776931 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-c4f44202-54a3-43ec-bf28-efa9a407fa05 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:40.778083 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-c4f44202-54a3-43ec-bf28-efa9a407fa05 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 24 09:35:40.778489 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 30/61] 10.222.0.65 () {56 vars in 1074 bytes} [Fri Jun 24 09:35:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:35:40.970925 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-8a6460d4-90b8-4ebc-a2ce-21967869f9da admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:35:40.990519 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-8a6460d4-90b8-4ebc-a2ce-21967869f9da admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.076405 Jun 24 09:35:40.990977 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 32/62] 10.222.0.65 () {60 vars in 1202 bytes} [Fri Jun 24 09:35:40 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:36:28.427827 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-c4f44202-54a3-43ec-bf28-efa9a407fa05 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:36:28.428852 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-c4f44202-54a3-43ec-bf28-efa9a407fa05 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jun 24 09:36:28.429255 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 31/63] 10.222.0.65 () {54 vars in 930 bytes} [Fri Jun 24 09:36:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:36:28.439686 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:36:28.490754 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-e2a09549-139f-4da2-9c7e-34c6d9b2e579 admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:36:28.512014 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-e2a09549-139f-4da2-9c7e-34c6d9b2e579 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076856 Jun 24 09:36:28.512557 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 33/64] 10.222.0.65 () {60 vars in 1291 bytes} [Fri Jun 24 09:36:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:36:28.532699 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG dbcounter [-] [109844] Writing DB stats nova_api:SELECT=14 {{(pid=109844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:36:28.544030 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-c4bf9789-0507-4a9b-bb14-7afd52417716 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:36:28.552813 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-c4bf9789-0507-4a9b-bb14-7afd52417716 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020982 Jun 24 09:36:28.553359 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 32/65] 10.222.0.65 () {60 vars in 1282 bytes} [Fri Jun 24 09:36:28 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:36:28.569487 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-20330126-751d-4a48-99e2-859309e1fc37 admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:36:28.577673 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-20330126-751d-4a48-99e2-859309e1fc37 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013005 Jun 24 09:36:28.578192 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 34/66] 10.222.0.65 () {60 vars in 1285 bytes} [Fri Jun 24 09:36:28 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:36:28.589850 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-2d094d07-6cf2-4995-afe0-1d09f821145c admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:36:28.597749 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-2d094d07-6cf2-4995-afe0-1d09f821145c admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011579 Jun 24 09:36:28.598361 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 33/67] 10.222.0.65 () {60 vars in 1285 bytes} [Fri Jun 24 09:36:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:36:28.610336 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-a94db5d0-4899-4db2-8147-7872b0d3fd1e admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:36:28.618145 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-a94db5d0-4899-4db2-8147-7872b0d3fd1e admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011894 Jun 24 09:36:28.618675 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 35/68] 10.222.0.65 () {60 vars in 1282 bytes} [Fri Jun 24 09:36:28 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:39:45.974669 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-2d094d07-6cf2-4995-afe0-1d09f821145c admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:39:45.975711 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-2d094d07-6cf2-4995-afe0-1d09f821145c admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jun 24 09:39:45.976124 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 34/69] 10.222.0.65 () {56 vars in 1074 bytes} [Fri Jun 24 09:39:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:39:46.124270 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writing DB stats nova_api:SELECT=6 {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:39:46.247965 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-d6967e35-95bd-466f-aab8-136fe9a32caa admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:39:46.249215 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:39:46.249215 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: warnings.warn(msg) Jun 24 09:39:46.250443 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-d6967e35-95bd-466f-aab8-136fe9a32caa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:39:46.250869 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-d6967e35-95bd-466f-aab8-136fe9a32caa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:39:46.251697 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-d6967e35-95bd-466f-aab8-136fe9a32caa admin admin] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:39:46.252141 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-d6967e35-95bd-466f-aab8-136fe9a32caa admin admin] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:39:46.286094 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-d6967e35-95bd-466f-aab8-136fe9a32caa admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.164389 Jun 24 09:39:46.286725 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 36/70] 10.222.0.65 () {60 vars in 1193 bytes} [Fri Jun 24 09:39:46 2022] GET /compute/v2.1/os-services => generated 794 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:39:47.141833 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-2d094d07-6cf2-4995-afe0-1d09f821145c admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:39:47.142893 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-2d094d07-6cf2-4995-afe0-1d09f821145c admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001833 Jun 24 09:39:47.143345 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 35/71] 10.222.0.65 () {56 vars in 1074 bytes} [Fri Jun 24 09:39:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:39:47.348076 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-e8ecc7dc-a17d-4c10-a335-e15e0ac5e551 admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:39:47.349395 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:39:47.349395 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: warnings.warn(msg) Jun 24 09:39:47.350634 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-e8ecc7dc-a17d-4c10-a335-e15e0ac5e551 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:39:47.351097 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-e8ecc7dc-a17d-4c10-a335-e15e0ac5e551 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:39:47.351873 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-e8ecc7dc-a17d-4c10-a335-e15e0ac5e551 admin admin] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:39:47.352294 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-e8ecc7dc-a17d-4c10-a335-e15e0ac5e551 admin admin] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:39:47.373040 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-e8ecc7dc-a17d-4c10-a335-e15e0ac5e551 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.091083 Jun 24 09:39:47.373601 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 37/72] 10.222.0.65 () {60 vars in 1193 bytes} [Fri Jun 24 09:39:47 2022] GET /compute/v2.1/os-services => generated 794 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:39:58.659769 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-2d094d07-6cf2-4995-afe0-1d09f821145c admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:39:58.660815 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-2d094d07-6cf2-4995-afe0-1d09f821145c admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jun 24 09:39:58.661213 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 36/73] 10.222.0.65 () {56 vars in 1074 bytes} [Fri Jun 24 09:39:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:39:58.807868 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writing DB stats nova_cell0:SELECT=4 {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:39:58.808951 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writing DB stats nova_cell1:SELECT=4 {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:39:58.810327 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writing DB stats nova_api:SELECT=8 {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:39:58.866795 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-fbe6a830-1988-4cc5-9237-0c880a36bfc1 admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:39:58.867997 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:39:58.867997 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: warnings.warn(msg) Jun 24 09:39:58.869198 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-fbe6a830-1988-4cc5-9237-0c880a36bfc1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:39:58.869636 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-fbe6a830-1988-4cc5-9237-0c880a36bfc1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:39:58.870410 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-fbe6a830-1988-4cc5-9237-0c880a36bfc1 admin admin] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:39:58.870834 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-fbe6a830-1988-4cc5-9237-0c880a36bfc1 admin admin] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:39:58.896564 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-fbe6a830-1988-4cc5-9237-0c880a36bfc1 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.096621 Jun 24 09:39:58.897184 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 38/74] 10.222.0.65 () {60 vars in 1193 bytes} [Fri Jun 24 09:39:58 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:39:59.733501 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-2d094d07-6cf2-4995-afe0-1d09f821145c admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:39:59.734508 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-2d094d07-6cf2-4995-afe0-1d09f821145c admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 24 09:39:59.735282 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 37/75] 10.222.0.65 () {56 vars in 1074 bytes} [Fri Jun 24 09:39:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:39:59.940357 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-0df8a2d8-3428-4ea2-b79b-b4c80296c7f8 admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:39:59.941521 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:39:59.941521 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: warnings.warn(msg) Jun 24 09:39:59.943298 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-0df8a2d8-3428-4ea2-b79b-b4c80296c7f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:39:59.943735 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-0df8a2d8-3428-4ea2-b79b-b4c80296c7f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:39:59.944546 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-0df8a2d8-3428-4ea2-b79b-b4c80296c7f8 admin admin] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:39:59.944970 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-0df8a2d8-3428-4ea2-b79b-b4c80296c7f8 admin admin] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:39:59.967503 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-0df8a2d8-3428-4ea2-b79b-b4c80296c7f8 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.091568 Jun 24 09:39:59.968047 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 39/76] 10.222.0.65 () {60 vars in 1193 bytes} [Fri Jun 24 09:39:59 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:40:56.294113 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: Fri Jun 24 09:40:56 2022 - graceful shutdown triggered... Jun 24 09:40:56.294175 dv-cinder-803823-13-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 24 09:40:56.295069 dv-cinder-803823-13-iscsi devstack@n-api.service[109843]: Gracefully killing worker 1 (pid: 109843)... Jun 24 09:40:56.295459 dv-cinder-803823-13-iscsi devstack@n-api.service[109844]: Gracefully killing worker 2 (pid: 109844)... Jun 24 09:40:57.296060 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: worker 1 buried after 1 seconds Jun 24 09:40:57.296060 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: worker 2 buried after 1 seconds Jun 24 09:40:57.296060 dv-cinder-803823-13-iscsi devstack@n-api.service[109842]: goodbye to uWSGI. Jun 24 09:40:57.297704 dv-cinder-803823-13-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 24 09:40:57.298292 dv-cinder-803823-13-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 24 09:40:57.301457 dv-cinder-803823-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 09:40:57.312386 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 09:40:57.314435 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 09:40:57 2022] *** Jun 24 09:40:57.314435 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 09:40:57.314435 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 09:40:57.314435 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: nodename: dv-cinder-803823-13-iscsi Jun 24 09:40:57.314435 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: machine: x86_64 Jun 24 09:40:57.314435 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: clock source: unix Jun 24 09:40:57.314435 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: pcre jit disabled Jun 24 09:40:57.314435 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: detected number of CPU cores: 4 Jun 24 09:40:57.314435 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: current working directory: / Jun 24 09:40:57.314435 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: detected binary path: /usr/bin/uwsgi-core Jun 24 09:40:57.314435 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: your processes number limit is 47680 Jun 24 09:40:57.314435 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: your memory page size is 4096 bytes Jun 24 09:40:57.314435 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: detected max file descriptor number: 2048 Jun 24 09:40:57.314435 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: lock engine: pthread robust mutexes Jun 24 09:40:57.315931 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: thunder lock: enabled Jun 24 09:40:57.315931 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 09:40:57.315931 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 09:40:57.361591 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: Python main interpreter initialized at 0x5564a50929c0 Jun 24 09:40:57.361591 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: python threads support enabled Jun 24 09:40:57.361591 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: your server socket listen backlog is limited to 100 connections Jun 24 09:40:57.361591 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: your mercy for graceful operations on workers is 90 seconds Jun 24 09:40:57.362048 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 09:40:57.362048 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: *** Operational MODE: preforking *** Jun 24 09:40:57.362355 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: *** uWSGI is running in multiple interpreter mode *** Jun 24 09:40:57.362355 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: spawned uWSGI master process (pid: 124317) Jun 24 09:40:57.362603 dv-cinder-803823-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 09:40:57.363146 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: spawned uWSGI worker 1 (pid: 124338, cores: 1) Jun 24 09:40:57.363655 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: spawned uWSGI worker 2 (pid: 124339, cores: 1) Jun 24 09:40:57.363952 dv-cinder-803823-13-iscsi devstack@n-api.service[124317]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 09:40:58.021624 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 09:40:58.042431 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 09:40:59.207060 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 09:40:59.207060 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: from cryptography.utils import int_from_bytes Jun 24 09:40:59.207737 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 09:40:59.207737 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: from cryptography.utils import int_from_bytes Jun 24 09:40:59.253619 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 09:40:59.253619 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: from cryptography.utils import int_from_bytes Jun 24 09:40:59.254090 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 09:40:59.254090 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: from cryptography.utils import int_from_bytes Jun 24 09:41:01.597177 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 09:41:01.597177 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 09:41:01.597989 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 09:41:01.598331 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 09:41:01.598629 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 09:41:01.598893 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.599171 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.599720 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.599957 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.600241 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.600517 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.600855 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.601200 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.601525 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.602085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.602640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.602979 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-13-iscsi {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.603337 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.603655 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.603970 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.604280 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.604588 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.604906 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.605280 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.605748 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.606477 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.606778 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.607169 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.607475 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.607791 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.608124 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.608426 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.608739 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.609394 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.609703 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.610271 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-13-iscsi {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.610749 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.611063 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.611429 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.611835 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.612154 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.612465 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.612788 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.613131 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.613439 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.613785 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.614094 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.614415 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.614735 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.615038 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.615375 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.615685 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.616008 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.616314 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.616620 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.616964 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.617274 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.617597 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.617918 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.618242 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.618493 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.618743 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.619061 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.619407 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.619715 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.620024 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.620350 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.620639 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.620945 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.621250 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.621556 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.621861 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.622183 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.622499 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.622824 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.623155 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.623478 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.623888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.624132 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.624441 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.624784 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.625104 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.625412 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.625732 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.626053 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.626361 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.626669 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.626975 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.627325 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.627660 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.627969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.628221 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.628523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.628828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.629149 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.629457 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.629765 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.630074 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.630380 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.630783 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.631002 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.631422 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.631730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.632039 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.632410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.632918 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.633233 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.633543 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.633874 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.634197 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.634507 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.634814 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.635198 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.635464 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.636008 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.636295 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.636612 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.637488 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.637488 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.637805 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.637932 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.638177 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.639108 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.639108 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.639108 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.639493 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.639747 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.640058 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.640371 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.640683 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.640989 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.642267 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.642267 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.642267 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.642267 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.642801 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.642801 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.643113 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.644271 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.644271 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.644271 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.644980 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.644980 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.644980 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.645443 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.645931 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.645931 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.646300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.646619 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.646935 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.647285 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.647612 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.647930 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.648303 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.648620 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.649039 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.649374 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.649714 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.650036 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.650365 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.650670 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.650975 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.651323 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.651665 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.651994 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.652309 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.652655 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.653013 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.653332 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.653662 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.653992 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.654308 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.654622 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.654936 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.655303 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.655641 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.655965 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.656286 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.656575 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.656891 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.657205 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.657519 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.657833 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.658187 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.658508 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.658836 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.659238 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.659501 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.659816 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.660133 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.660446 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.660759 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.661110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.661374 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.661835 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.662001 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.662328 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.662665 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.663046 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.663347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.665217 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.665217 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.665217 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.665217 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.665879 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.665879 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.666549 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.666549 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.666861 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.667013 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.667239 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.667571 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.667886 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.668199 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.668528 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.671240 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.671240 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.671240 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.671240 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.671240 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.671240 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.671240 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.671240 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.671958 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.671958 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.672123 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.672350 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.672632 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.672953 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.673280 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.673581 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.673893 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.674235 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.674549 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.674837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.675165 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.675509 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.675816 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.676106 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.676451 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.676763 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.677046 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.677356 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.677666 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.678021 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.678336 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.678691 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.679067 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.679553 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.679891 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.680377 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.680707 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.681024 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.681344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.681664 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.681965 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.682289 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.682606 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.682920 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.683276 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.683616 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.683936 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.684263 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.684601 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.684912 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.685260 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.685604 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.685921 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.686251 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.686565 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.686883 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.687234 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.687551 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.687869 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.688185 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.688511 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.688826 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.689151 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.689467 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.689796 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.690115 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.690439 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.690747 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.691068 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.691430 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.691771 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.692069 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.692380 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.692803 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.693019 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.693329 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.693759 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.693947 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.694353 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.694571 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.695347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.695713 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.696028 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.696334 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.696651 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.696968 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.697281 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.697584 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.697911 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.698245 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.698560 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.698892 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.699243 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.699553 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.699865 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.700177 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.700491 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.700803 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.701113 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.701444 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.701776 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.702094 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.702405 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.702728 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.703056 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.703421 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.703759 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.704066 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.705197 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.705197 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.705197 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.705701 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.705701 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.706005 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.706480 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.706641 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.707303 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.707303 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.707632 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.707827 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.708111 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.708424 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.708746 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.709343 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.709688 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.710010 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.710313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.710675 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.710999 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.711441 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.711790 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.712141 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.712454 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.712770 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.713082 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.713397 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.713710 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.714019 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.714330 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.714706 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.714949 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.715384 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.715589 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.715893 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.716203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.716720 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.716902 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.717131 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.717440 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.717773 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.718138 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.718392 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.718699 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.719008 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.719383 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.719695 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.720042 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.720376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.720725 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.721038 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.721351 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.721681 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.721991 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.722301 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.722745 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.722916 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.723428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.723604 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.723858 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.724174 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.724518 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.724890 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.725106 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.725431 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.725728 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.726067 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.726680 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.727001 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.727346 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.727666 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.727982 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.728292 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.728608 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.728917 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.729239 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.729549 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.729860 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.730190 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 09:41:01.730684 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.730833 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 09:41:01.730975 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.730975 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.731326 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 09:41:01.731478 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.731478 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.731773 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.731935 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 09:41:01.732126 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.732289 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 09:41:01.732453 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.732641 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.732791 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.732935 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.733090 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.733234 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.733403 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.733730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.734287 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.734448 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.734612 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.734764 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.734942 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.735243 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.735412 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.736381 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.736547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.736717 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.736950 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.736950 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.737407 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.737407 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.737694 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.737848 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.737992 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-13-iscsi {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.738137 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.738295 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.738477 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.738629 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.738772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.738915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.739058 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.739264 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.739418 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.739569 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.739728 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.739883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.740026 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.740213 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.740364 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.740518 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.740714 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.740871 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.741035 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.741181 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.741325 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.741488 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.741640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.741931 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.742129 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.742285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.742583 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.742735 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.742877 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.743028 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.743220 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.743367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.743518 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.743680 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.744011 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.744161 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.744320 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.744499 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-13-iscsi {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.744656 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.744808 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.744966 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.745118 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.745422 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.745580 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.745818 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.746135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.746303 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.746502 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.746660 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.746804 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.746964 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.747233 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.747498 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.747650 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.747803 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.747956 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.748100 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.748282 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.748443 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.748597 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.748794 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.748943 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.749095 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.749249 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.749393 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.749544 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.749694 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.749849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.750001 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.750155 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.750306 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.750450 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.750612 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.750757 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.750905 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.751058 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.751237 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.751389 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.751539 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.751681 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.751832 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.751990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.752141 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.752285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.752433 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.752689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.753497 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.753681 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.753681 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.754314 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.754314 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.754802 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.755005 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.755252 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.755252 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.755864 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.756188 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.757471 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.757753 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.757936 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.758118 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.758298 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.758496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.758675 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.758853 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.759032 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.759227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.759405 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.759617 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.759798 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.759983 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.760171 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.760362 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.760551 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.760753 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.761002 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.761195 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.761384 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.761556 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.761750 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.761929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.762112 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.762274 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.762419 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.762609 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.762859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.763010 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.763202 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.763397 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.763547 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.763690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.763843 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.763994 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.764138 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.764501 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.764673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.764844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.765002 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.765155 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.765299 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.765451 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.765780 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.765956 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.766206 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.766454 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.766611 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.766755 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.766918 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.767092 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.767261 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.767534 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.767713 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.767944 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.767944 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.768240 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.768392 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.768544 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.768724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.768880 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.769044 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.769203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.769349 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.769491 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.769634 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.769784 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.769938 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.770090 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.770241 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.770384 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.770533 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.770718 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.770881 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.771050 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.771279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.771425 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.771566 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.771719 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.771873 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.772017 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.772158 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.772158 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.772437 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.772578 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.772779 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.773064 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.773278 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.773428 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.773571 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.773713 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.773871 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.774024 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.774169 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.774169 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.774470 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.774827 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.774988 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.775150 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.775317 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.775317 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.775619 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.775943 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.776093 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.776340 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.776597 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.776755 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.776902 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.777052 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.777195 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.777357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.777530 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.777767 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.777943 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.778163 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.778310 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.778461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.778614 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.778759 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.778911 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.779056 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.779258 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.779422 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.779575 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.779727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.779935 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.780093 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.780238 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.780391 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.780542 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.780684 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.780835 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.780978 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.781139 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.781302 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.781446 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.781588 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.781731 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.781731 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.782033 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.782178 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.782348 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.783235 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.783348 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.783442 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.783593 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.783694 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.783791 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.783885 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.783970 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:41:01.784055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.784153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.784240 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.784240 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.784392 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.784483 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.784568 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.784663 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.784755 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.784844 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.784916 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.784986 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.785073 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.785158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.785251 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.785342 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.785427 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.785427 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.785587 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.785673 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.785756 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.785848 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.785927 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.786005 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.786093 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.786178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.786270 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.786361 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.786439 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.786532 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.786620 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.786705 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.786785 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.786856 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.786925 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.787007 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.787100 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.787100 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.787245 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.787377 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.787488 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.787683 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.787796 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.787904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.788030 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.788164 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.788297 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.788434 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.788586 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.788779 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.788915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.789040 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.789173 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.789173 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.789173 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.789173 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.789173 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.789173 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.789173 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.789173 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.790127 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.790127 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.790127 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.790127 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.790127 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.790127 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.790127 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.790948 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.791100 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.791100 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.791100 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.791486 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.791622 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.791747 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.791879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.791879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.792137 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.792272 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.792272 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.792524 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.792651 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.792651 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.792898 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.793024 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.793024 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.793271 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.793396 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.793396 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.793702 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.793861 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.793861 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.794153 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.794294 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.794294 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.794573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.794714 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.794714 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.794714 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.795148 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.795310 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.795452 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.795594 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.795594 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.795871 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.796025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.796176 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.796326 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.796466 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.796606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.796606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.796882 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.797023 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.797023 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.797296 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.797445 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.797596 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.797752 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.797894 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.798043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.798191 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.798340 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.798340 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.798632 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.798774 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.798923 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.799089 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.799238 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.799391 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.799595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.799744 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.799893 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.800079 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.800227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.800413 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.800569 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.800745 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.800900 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.801135 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.801294 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.801469 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.801635 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.801777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.801924 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.802066 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.802215 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.802366 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.802510 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.802650 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.802790 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.802961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.803153 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.803302 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.803566 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.803724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.803904 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.804050 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.804261 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.804446 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.804599 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.804741 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.804893 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.805082 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.805247 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.805439 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.805752 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.805924 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.806068 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.806314 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.806471 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.806648 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.806803 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.806997 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.807305 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.807488 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.807632 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.807773 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.807948 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.808116 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.808308 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.808507 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.808663 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.808845 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.809002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.809182 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.809346 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.809511 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.809667 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.809838 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.809985 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.810134 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.810293 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.810445 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.810586 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.810740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.810889 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.811063 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.811273 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.811416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.811565 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.811705 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.811845 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.812034 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.812192 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.812352 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.812507 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.812659 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.812808 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.812959 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.813101 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.813242 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.813382 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.813589 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.813794 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.813952 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.814234 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.814396 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.814547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.814697 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.814865 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.815021 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.815223 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.815620 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.815778 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.815919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.816074 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.816216 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.816448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.816601 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.816755 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.816897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.817073 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.817339 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.817488 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.817661 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.817819 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.817961 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.818119 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.818308 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.818463 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.818635 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.818813 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.818987 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.819231 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.819380 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.819528 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.819669 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.819971 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.820207 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.820369 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.820542 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.820698 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.820877 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.821025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.821202 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.821360 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.821626 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.821826 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.821981 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.822198 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.822359 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.822527 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.822674 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.822823 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.822963 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.823179 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.823339 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.823515 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.823664 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.823832 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.823987 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.824139 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.824354 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.824498 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.824638 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.824796 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.824938 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.825096 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.825247 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.825388 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.825547 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.825707 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.825940 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.826248 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.826568 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.826895 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.831118 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.831259 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.831348 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.831348 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.831511 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.831597 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.831673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.831746 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.831826 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.831914 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.831995 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.832076 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.832149 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.832219 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.832299 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.832380 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.832454 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.832532 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.832614 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.832694 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.832782 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.832863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.832936 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.833008 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.833086 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.833160 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.833247 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.833320 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.833391 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.833469 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.833549 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.833629 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.833736 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.833825 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.833905 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.833977 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.834055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.834135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.834214 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.834293 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.834373 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.834445 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.834522 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.834608 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.834694 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.834767 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.834837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.834920 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.835151 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.835246 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.835246 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.835608 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.835889 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.836046 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.836276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.836504 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.836649 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.837055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.837238 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.837501 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.837640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.837821 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.838021 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.838159 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.838453 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.838605 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.838758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.838953 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.839136 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.839443 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.839592 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.839802 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.839935 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.840115 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.840432 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.840679 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.840818 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.841046 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.841175 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.841360 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.841621 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.841761 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.841963 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.842152 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.842282 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.842570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.842710 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.842880 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.843124 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.843262 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.843511 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.843661 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.843821 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.844002 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.844135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.844436 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.844566 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.844750 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.844936 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.845070 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.845374 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.845505 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.845722 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.845875 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.846025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.846291 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.846440 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.846580 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.846959 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.847143 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.847324 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.847531 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.847679 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.847925 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.848127 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.848261 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.848390 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.848607 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.848826 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.848958 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.849202 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.849340 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.849476 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.849743 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.849876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.850065 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.850231 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.850372 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.850668 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.850801 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.850979 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.851328 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.851475 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.851682 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.851892 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.852028 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.852335 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.852483 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.852646 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.852828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.852968 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.853256 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.853394 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.853587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.853756 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.853895 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.854176 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.854315 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.854489 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.854680 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.854811 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.855138 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.855285 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.855437 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.855626 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.855773 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.856043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.856175 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.856411 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.856665 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.856813 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.856978 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.857300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.857442 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.857596 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.857798 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.857941 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.858180 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.858433 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.858589 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.859260 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.859407 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.859611 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.859768 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.859922 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.860224 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.860355 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.860536 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.860711 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.860860 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.861153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.861327 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.861486 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.861654 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.861814 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.862086 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.862257 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.862424 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.862591 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.862748 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.863004 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.863250 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.863395 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.863524 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.863666 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.863929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.864060 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.864239 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.864480 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.864619 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.864844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.864983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.865154 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.865404 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.865534 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.865783 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.865920 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.866129 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.866296 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.866438 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.866718 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.866939 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.867171 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.867384 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.867591 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.867723 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.868172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.868313 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.868442 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.868578 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.868707 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.868920 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.869060 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.869259 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.869399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.869679 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.869811 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.869995 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.870156 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.870302 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.870588 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.870727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.870923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.871053 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.871263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.871519 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.871651 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.871888 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.872024 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.872205 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.872405 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.872551 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.872835 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.872973 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.873160 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.873296 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.873490 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.873725 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.873856 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.874095 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.874232 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.874409 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.874624 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.874756 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.875020 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.875171 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.875370 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.875542 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.875690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.875974 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.876121 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.876313 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.876452 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.876598 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.877425 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.877700 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.877845 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.878059 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.878191 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.878191 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.878443 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.878582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.879056 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.879233 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.879233 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.879493 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.879665 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.879813 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.879990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.879990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.880234 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.880371 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.880506 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.880645 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.880786 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.880914 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.881705 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.881868 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.882008 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.882148 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.882309 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.882465 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.882594 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.882594 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.882925 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.883065 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.883065 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.883380 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.883563 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.883700 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.883840 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.883997 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.884126 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.884313 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.884492 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.884626 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.884924 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.885063 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.885234 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.885416 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.885555 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.885863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.886009 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.886173 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.886408 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.886547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.886923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.887104 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.887249 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.887381 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.887519 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.887843 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.887988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.888225 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.888418 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.888550 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.888755 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.888909 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.889180 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.889338 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.889499 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.889792 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.889932 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.890240 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.890378 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.890632 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.890726 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.890967 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.891062 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.891313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.891413 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.891720 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.891823 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.891964 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.892081 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.892286 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.892394 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.892619 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.892741 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.892934 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.893031 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.893253 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.893365 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.893565 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.893659 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.893895 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.893995 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.894225 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.894329 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.894544 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.894638 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.894872 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.894972 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.895300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.895414 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.895630 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.895731 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.895947 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.896046 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.896261 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.896354 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.896512 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 09:41:01.896613 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.896905 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.897206 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.897521 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.897832 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.898174 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.898506 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.898815 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.899159 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.899476 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.899817 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.900124 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.900431 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.900760 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.901074 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.901401 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.901719 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.902046 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.902372 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.902683 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.903012 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.903351 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.903659 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.903966 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.904273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.904625 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.904936 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.905265 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.905603 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.905942 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.906257 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.906600 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.906937 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.907288 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.907613 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.907945 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.908255 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.908564 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.908879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.909187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.909495 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.909808 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.910123 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.910433 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.910743 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.911200 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.911410 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.911720 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.912053 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.915119 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.915119 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.915119 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.915119 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.915119 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.915119 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.915119 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.915119 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.915682 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.915682 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.915682 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.915899 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.916317 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.916639 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.916962 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.917352 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.917605 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.917913 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.918234 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.918651 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.918862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.919214 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.919541 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.920123 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.920463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.920786 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.921114 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.921435 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.921758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.922079 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.922398 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.922713 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.923028 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.923370 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.923705 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.924034 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.924364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.924709 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.925032 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.925351 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.925670 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.925988 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.926353 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.926673 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.926987 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.927338 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.927650 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.927968 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.928284 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.928615 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.928917 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.929307 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.929625 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.929939 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.930258 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.930576 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.930912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.931280 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.931608 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.931930 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.932251 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.932573 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.933100 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.933421 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.933763 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.934095 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.934426 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.934748 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.935087 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.935422 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.935736 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.936049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.936364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.936689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.936992 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.937318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.937633 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.937944 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.938269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.938583 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.939148 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.939528 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.939813 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.940145 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.940477 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.940806 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.941121 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.941456 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.941769 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.942080 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.942403 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.942721 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.943301 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.943392 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.943659 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.943977 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.944287 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.944605 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.944966 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.945299 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.945614 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.946012 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.946387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.946542 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.946855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.947201 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.947516 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.947827 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.948145 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.948453 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.948766 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.949081 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.949399 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.949717 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.950037 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.950395 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.950724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.951039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.951370 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.951692 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.952009 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.952337 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.952654 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.952969 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.953321 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.953647 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.954194 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.954535 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.954860 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.955224 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.955563 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.955877 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.956190 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.956504 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.956834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.957148 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.957466 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.957782 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.958098 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.958276 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO dbcounter [None req-ef5ffec0-38cb-45e3-861a-33ef8c5d2a8d None None] Registered counter for database nova_api Jun 24 09:41:01.958413 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.958728 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.959623 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.959623 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.959856 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.959979 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.960292 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.960633 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.960954 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.961274 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.961621 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.961945 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.962266 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.962590 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.962915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.963253 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.963569 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.963884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.964196 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.964519 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.964854 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.965175 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.965486 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.966014 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.966334 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.966658 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.966984 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.967322 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.967652 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.967980 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.968295 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.968621 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.968938 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.969274 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.969617 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.969952 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.970283 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.970598 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.970914 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.971245 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.971558 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.971881 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.972194 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.972502 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.972810 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.973123 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.973430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.973738 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.974049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.976573 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.976573 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.976573 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.976573 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.976573 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.976573 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.976573 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.976573 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.977902 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.977902 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.977902 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.977902 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.978453 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.978453 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.978771 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.979042 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.979400 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_db.sqlalchemy.engines [None req-ef5ffec0-38cb-45e3-861a-33ef8c5d2a8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:41:01.979578 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.979732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.980005 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.980338 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.980651 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.980987 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.981317 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.981641 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.981957 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.982297 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.982616 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.982932 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.983272 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.983590 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.984262 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.984579 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.984912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.985243 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.985555 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.985886 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.986208 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.986365 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writer thread running {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:41:01.986533 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.986838 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.987182 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.987520 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.987835 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.988148 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.988467 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.988779 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.989093 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.989413 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.989733 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.990066 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.990430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.990749 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.991115 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.991435 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.991865 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.992169 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.992518 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.992853 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.993170 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.993472 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.993781 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:41:01.994028 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 09:41:02.042586 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.context [None req-ef5ffec0-38cb-45e3-861a-33ef8c5d2a8d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f2d2cbef-ff41-499b-a255-74c93eabe11c(cell1) {{(pid=124338) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 09:41:02.046744 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ef5ffec0-38cb-45e3-861a-33ef8c5d2a8d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:41:02.048389 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ef5ffec0-38cb-45e3-861a-33ef8c5d2a8d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:41:02.049192 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ef5ffec0-38cb-45e3-861a-33ef8c5d2a8d None None] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:41:02.051224 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ef5ffec0-38cb-45e3-861a-33ef8c5d2a8d None None] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:41:02.053239 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO dbcounter [None req-ef5ffec0-38cb-45e3-861a-33ef8c5d2a8d None None] Registered counter for database nova_cell0 Jun 24 09:41:02.055468 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO dbcounter [None req-38ab1e87-2a00-4243-a8db-a5bfcf263a6c None None] Registered counter for database nova_api Jun 24 09:41:02.057627 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO dbcounter [None req-ef5ffec0-38cb-45e3-861a-33ef8c5d2a8d None None] Registered counter for database nova_cell1 Jun 24 09:41:02.064953 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_db.sqlalchemy.engines [None req-ef5ffec0-38cb-45e3-861a-33ef8c5d2a8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:41:02.066828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_db.sqlalchemy.engines [None req-ef5ffec0-38cb-45e3-861a-33ef8c5d2a8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:41:02.073473 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writer thread running {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:41:02.076160 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_db.sqlalchemy.engines [None req-38ab1e87-2a00-4243-a8db-a5bfcf263a6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:41:02.078627 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writer thread running {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:41:02.083102 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writer thread running {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:41:02.140168 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.context [None req-38ab1e87-2a00-4243-a8db-a5bfcf263a6c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f2d2cbef-ff41-499b-a255-74c93eabe11c(cell1) {{(pid=124339) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 09:41:02.144271 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-38ab1e87-2a00-4243-a8db-a5bfcf263a6c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:41:02.145879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-38ab1e87-2a00-4243-a8db-a5bfcf263a6c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:41:02.146688 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-38ab1e87-2a00-4243-a8db-a5bfcf263a6c None None] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:41:02.148943 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-38ab1e87-2a00-4243-a8db-a5bfcf263a6c None None] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:41:02.150959 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO dbcounter [None req-38ab1e87-2a00-4243-a8db-a5bfcf263a6c None None] Registered counter for database nova_cell0 Jun 24 09:41:02.155053 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO dbcounter [None req-38ab1e87-2a00-4243-a8db-a5bfcf263a6c None None] Registered counter for database nova_cell1 Jun 24 09:41:02.162515 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_db.sqlalchemy.engines [None req-38ab1e87-2a00-4243-a8db-a5bfcf263a6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:41:02.164350 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_db.sqlalchemy.engines [None req-38ab1e87-2a00-4243-a8db-a5bfcf263a6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:41:02.170422 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writer thread running {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:41:02.172057 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writer thread running {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:41:02.223262 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO dbcounter [None req-ef5ffec0-38cb-45e3-861a-33ef8c5d2a8d None None] Registered counter for database nova_cell0 Jun 24 09:41:02.230441 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_db.sqlalchemy.engines [None req-ef5ffec0-38cb-45e3-861a-33ef8c5d2a8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:41:02.235872 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writer thread running {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:41:02.320416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO dbcounter [None req-38ab1e87-2a00-4243-a8db-a5bfcf263a6c None None] Registered counter for database nova_cell0 Jun 24 09:41:02.327753 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_db.sqlalchemy.engines [None req-38ab1e87-2a00-4243-a8db-a5bfcf263a6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:41:02.334884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writer thread running {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:41:02.564084 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: WARNING keystonemiddleware.auth_token [None req-ef5ffec0-38cb-45e3-861a-33ef8c5d2a8d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 09:41:02.571840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: WARNING keystonemiddleware.auth_token [None req-ef5ffec0-38cb-45e3-861a-33ef8c5d2a8d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 09:41:02.657625 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: WARNING keystonemiddleware.auth_token [None req-38ab1e87-2a00-4243-a8db-a5bfcf263a6c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 09:41:02.665157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: WARNING keystonemiddleware.auth_token [None req-38ab1e87-2a00-4243-a8db-a5bfcf263a6c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 09:41:02.918179 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: WARNING keystonemiddleware.auth_token [None req-ef5ffec0-38cb-45e3-861a-33ef8c5d2a8d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 09:41:02.925067 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: WARNING keystonemiddleware.auth_token [None req-ef5ffec0-38cb-45e3-861a-33ef8c5d2a8d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 09:41:02.930949 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5564a50929c0 pid: 124338 (default app) Jun 24 09:41:03.012108 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: WARNING keystonemiddleware.auth_token [None req-38ab1e87-2a00-4243-a8db-a5bfcf263a6c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 09:41:03.018215 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: WARNING keystonemiddleware.auth_token [None req-38ab1e87-2a00-4243-a8db-a5bfcf263a6c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 09:41:03.024115 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5564a50929c0 pid: 124339 (default app) Jun 24 09:41:44.266338 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=3 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:41:44.268381 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=3 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:41:44.269828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=3 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:41:44.272123 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=3 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:41:45.946348 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-2c02a4ce-3dbb-4142-a1d0-b8ca8e4d6f07 tempest-VolumesGetTestJSON-843006147 tempest-VolumesGetTestJSON-843006147-project] Action: 'create', calling method: .version_select at 0x7fc6d6bcd700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2112196379", "metadata": {"Type": "work"}}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:41:47.579283 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-2c02a4ce-3dbb-4142-a1d0-b8ca8e4d6f07 tempest-VolumesGetTestJSON-843006147 tempest-VolumesGetTestJSON-843006147-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.326506 Jun 24 09:41:47.586633 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 1/1] 10.222.0.65 () {60 vars in 1155 bytes} [Fri Jun 24 09:41:44 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3330 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 24 09:41:47.595519 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=3 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:41:47.596416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=3 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:41:47.597243 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=3 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:41:47.601035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=3 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:41:48.184031 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7a49fdf7-8cf2-47d9-94d9-c49fb42ff180 tempest-VolumesGetTestJSON-843006147 tempest-VolumesGetTestJSON-843006147-project] Calling method '.version_select at 0x7fc6d6c133a0>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:41:48.984603 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-7a49fdf7-8cf2-47d9-94d9-c49fb42ff180 tempest-VolumesGetTestJSON-843006147 tempest-VolumesGetTestJSON-843006147-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/8bff447e-d09e-454c-a648-c8306f3f5d58" status: 200 len: 354 microversion: 2.1 time: 1.394569 Jun 24 09:41:48.985990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 1/2] 10.222.0.65 () {58 vars in 1244 bytes} [Fri Jun 24 09:41:47 2022] GET /compute/v2.1/os-volumes/8bff447e-d09e-454c-a648-c8306f3f5d58 => generated 354 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:41:49.000029 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-91e1863e-08a5-442e-8863-67c6eb6955ed tempest-VolumesGetTestJSON-843006147 tempest-VolumesGetTestJSON-843006147-project] Calling method '.version_select at 0x7fc6d6a95550>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:41:49.138057 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-91e1863e-08a5-442e-8863-67c6eb6955ed tempest-VolumesGetTestJSON-843006147 tempest-VolumesGetTestJSON-843006147-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/8bff447e-d09e-454c-a648-c8306f3f5d58" status: 200 len: 354 microversion: 2.1 time: 0.142925 Jun 24 09:41:49.139297 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1244 bytes} [Fri Jun 24 09:41:48 2022] GET /compute/v2.1/os-volumes/8bff447e-d09e-454c-a648-c8306f3f5d58 => generated 354 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:41:49.181912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1bad4890-1479-4728-a0c2-549004846a38 tempest-VolumesGetTestJSON-843006147 tempest-VolumesGetTestJSON-843006147-project] Calling method '.version_select at 0x7fc6d6adc550>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:41:49.714886 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-1bad4890-1479-4728-a0c2-549004846a38 tempest-VolumesGetTestJSON-843006147 tempest-VolumesGetTestJSON-843006147-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/8bff447e-d09e-454c-a648-c8306f3f5d58" status: 202 len: 0 microversion: 2.1 time: 0.557871 Jun 24 09:41:49.716871 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 2/4] 10.222.0.65 () {58 vars in 1247 bytes} [Fri Jun 24 09:41:49 2022] DELETE /compute/v2.1/os-volumes/8bff447e-d09e-454c-a648-c8306f3f5d58 => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:41:49.739837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-5c441848-5eea-4f7b-a8ee-a2589e1ab4b4 tempest-VolumesGetTestJSON-843006147 tempest-VolumesGetTestJSON-843006147-project] Calling method '.version_select at 0x7fc6d6a95670>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:41:49.838667 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-5c441848-5eea-4f7b-a8ee-a2589e1ab4b4 tempest-VolumesGetTestJSON-843006147 tempest-VolumesGetTestJSON-843006147-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/8bff447e-d09e-454c-a648-c8306f3f5d58" status: 200 len: 353 microversion: 2.1 time: 0.116302 Jun 24 09:41:49.839280 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 3/5] 10.222.0.65 () {58 vars in 1244 bytes} [Fri Jun 24 09:41:49 2022] GET /compute/v2.1/os-volumes/8bff447e-d09e-454c-a648-c8306f3f5d58 => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:41:50.854152 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f61c2249-37d7-43e3-aa0c-3b85a1170960 tempest-VolumesGetTestJSON-843006147 tempest-VolumesGetTestJSON-843006147-project] Calling method '.version_select at 0x7fc6d6adcc10>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:41:50.934483 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-f61c2249-37d7-43e3-aa0c-3b85a1170960 tempest-VolumesGetTestJSON-843006147 tempest-VolumesGetTestJSON-843006147-project] HTTP exception thrown: Volume 8bff447e-d09e-454c-a648-c8306f3f5d58 could not be found. Jun 24 09:41:50.942758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f61c2249-37d7-43e3-aa0c-3b85a1170960 tempest-VolumesGetTestJSON-843006147 tempest-VolumesGetTestJSON-843006147-project] Request method failure captured: Jun 24 09:41:50.942758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/os-volumes/8bff447e-d09e-454c-a648-c8306f3f5d58 HTTP/1.1 Jun 24 09:41:50.942758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:41:50.942758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:41:50.942758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:41:50.942758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:41:50.942758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:41:50.942758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:41:50.942758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:41:50.942758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:41:50.942758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYbY4hZvP6d_iWPmIXsMbQi_Ji96muhx7lwSPMLYw9djPEw9opuHYMTfyzDJL6aRXh6hgQiWYfboLKbBlKcYLnGDZGYS6aqWc94HFusK66onSUd9aCMdBzaZNzJiEnil7mSGxaHxEQtg1igpL5pdGDwHuFpzKl0UJ-ol13bfMZRpe6E Jun 24 09:41:50.942758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:41:50.942758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:41:50.942758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:41:50.942758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:41:50.942758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:41:50.942758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:41:50.942758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: c7d337515eaf429e8ec6fb1e918dac56 Jun 24 09:41:50.942758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-VolumesGetTestJSON-843006147 Jun 24 09:41:50.942758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:41:50.942758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:41:50.943849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c7d337515eaf429e8ec6fb1e918dac56", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c7d337515eaf429e8ec6fb1e918dac56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7d337515eaf429e8ec6fb1e918dac56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7d337515eaf429e8ec6fb1e918dac56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:41:50.943849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-VolumesGetTestJSON-843006147 Jun 24 09:41:50.943849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: c7d337515eaf429e8ec6fb1e918dac56 Jun 24 09:41:50.943849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-VolumesGetTestJSON-843006147 Jun 24 09:41:50.943849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-VolumesGetTestJSON-843006147-project Jun 24 09:41:50.943849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:41:50.943849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:41:50.943849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: f1c24c05d8034f34a501f7b9d72e7be7 Jun 24 09:41:50.943849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-VolumesGetTestJSON-843006147-project Jun 24 09:41:50.943849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: Jun 24 09:41:50.943849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Volume 8bff447e-d09e-454c-a648-c8306f3f5d58 could not be found. Jun 24 09:41:50.943849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': '8bff447e-d09e-454c-a648-c8306f3f5d58'} Jun 24 09:41:50.943849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:41:50.944452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:41:50.944452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:41:50.944452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:41:50.944452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 09:41:50.944452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 09:41:50.944452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 09:41:50.944452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 09:41:50.944452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 09:41:50.944452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 09:41:50.944452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 09:41:50.944452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 09:41:50.944452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:41:50.944452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:41:50.944452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:41:50.944452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:41:50.944452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8bff447e-d09e-454c-a648-c8306f3f5d58 could not be found. (HTTP 404) (Request-ID: req-a741355b-a36a-440a-b9c0-b600e6e9ae85) Jun 24 09:41:50.944452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:41:50.944452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:41:50.944452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:41:50.945285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:41:50.945285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 09:41:50.945285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 09:41:50.945285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:41:50.945285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:41:50.945285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 09:41:50.945285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 09:41:50.945285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:41:50.945285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:41:50.945285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:41:50.945285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:41:50.945285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 09:41:50.945285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 09:41:50.945285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 09:41:50.945285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 09:41:50.945285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 09:41:50.945285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 09:41:50.945285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 09:41:50.945285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 09:41:50.946085 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:41:50.946085 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:41:50.946085 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:41:50.946085 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:41:50.946085 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8bff447e-d09e-454c-a648-c8306f3f5d58 could not be found. Jun 24 09:41:50.946085 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:41:50.946085 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:41:50.946085 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:41:50.946085 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:41:50.946085 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:41:50.946085 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:41:50.946085 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:41:50.946085 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:41:50.946085 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 09:41:50.946085 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 09:41:50.946085 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:41:50.946085 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:41:50.946085 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 09:41:50.946085 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:41:50.947711 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8bff447e-d09e-454c-a648-c8306f3f5d58 could not be found. Jun 24 09:41:50.947711 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:41:50.947711 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:41:50.947711 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:41:50.947711 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:41:50.947711 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:41:50.947711 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:41:50.947711 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:41:50.947711 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:41:50.947711 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8bff447e-d09e-454c-a648-c8306f3f5d58 could not be found. Jun 24 09:41:50.947711 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:41:50.947711 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f61c2249-37d7-43e3-aa0c-3b85a1170960 tempest-VolumesGetTestJSON-843006147 tempest-VolumesGetTestJSON-843006147-project] Returning 404 to user: Volume 8bff447e-d09e-454c-a648-c8306f3f5d58 could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:41:50.947711 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f61c2249-37d7-43e3-aa0c-3b85a1170960 tempest-VolumesGetTestJSON-843006147 tempest-VolumesGetTestJSON-843006147-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/8bff447e-d09e-454c-a648-c8306f3f5d58" status: 404 len: 109 microversion: 2.1 time: 0.095971 Jun 24 09:41:50.947711 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 3/6] 10.222.0.65 () {58 vars in 1244 bytes} [Fri Jun 24 09:41:50 2022] GET /compute/v2.1/os-volumes/8bff447e-d09e-454c-a648-c8306f3f5d58 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:41:53.882189 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-781afe77-a3b9-4c8f-adda-a3019a4b9b6a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-326296669", "imageRef": "844ad823-18a2-4abc-813c-2d1825141591", "flavorRef": "452", "networks": [{"uuid": "9369cf11-485b-46a3-a217-92b03ccfb37d"}]}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:41:54.119138 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.network.neutron [None req-781afe77-a3b9-4c8f-adda-a3019a4b9b6a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] validate_networks() for [('9369cf11-485b-46a3-a217-92b03ccfb37d', None, None, None, None, None)] {{(pid=124338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:41:56.919823 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-781afe77-a3b9-4c8f-adda-a3019a4b9b6a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Flavor limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:41:56.920471 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-781afe77-a3b9-4c8f-adda-a3019a4b9b6a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Image limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:41:56.920837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-781afe77-a3b9-4c8f-adda-a3019a4b9b6a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Flavor pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:41:56.921244 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-781afe77-a3b9-4c8f-adda-a3019a4b9b6a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Image pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:41:56.921660 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-781afe77-a3b9-4c8f-adda-a3019a4b9b6a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:41:56.959440 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-781afe77-a3b9-4c8f-adda-a3019a4b9b6a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:41:56.966798 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-781afe77-a3b9-4c8f-adda-a3019a4b9b6a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:41:56.968502 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-781afe77-a3b9-4c8f-adda-a3019a4b9b6a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:41:56.969828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-781afe77-a3b9-4c8f-adda-a3019a4b9b6a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:41:57.081974 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-781afe77-a3b9-4c8f-adda-a3019a4b9b6a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Getting quotas for project 4290bd187dc948bc9f1dc5a8cc272f0b. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:41:57.101466 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-781afe77-a3b9-4c8f-adda-a3019a4b9b6a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Getting quotas for user f1722779f6b74af59fa05a2b63890b2d and project 4290bd187dc948bc9f1dc5a8cc272f0b. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:41:57.134492 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-781afe77-a3b9-4c8f-adda-a3019a4b9b6a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Going to run 1 instances... {{(pid=124338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:41:57.149662 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-781afe77-a3b9-4c8f-adda-a3019a4b9b6a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='844ad823-18a2-4abc-813c-2d1825141591',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:41:57.321946 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-781afe77-a3b9-4c8f-adda-a3019a4b9b6a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.122165 Jun 24 09:41:57.324647 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 4/7] 10.222.0.65 () {60 vars in 1146 bytes} [Fri Jun 24 09:41:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 4126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 09:41:57.334122 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b39c1a18-9da4-4b2c-be65-78b99788cae1 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:41:57.337643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-b39c1a18-9da4-4b2c-be65-78b99788cae1 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:41:57.713907 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b39c1a18-9da4-4b2c-be65-78b99788cae1 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:41:57.766131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b39c1a18-9da4-4b2c-be65-78b99788cae1 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1214 microversion: 2.1 time: 0.433793 Jun 24 09:41:57.779307 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:41:57 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1214 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:41:58.785604 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-8194164c-e20f-46a5-abb1-7b16ed83a4e9 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:41:58.786283 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-8194164c-e20f-46a5-abb1-7b16ed83a4e9 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:41:59.248327 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-8194164c-e20f-46a5-abb1-7b16ed83a4e9 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:41:59.287664 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-8194164c-e20f-46a5-abb1-7b16ed83a4e9 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1214 microversion: 2.1 time: 0.505843 Jun 24 09:41:59.291434 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 5/9] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:41:58 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1214 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:00.307984 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-fd7d3590-135e-4bb7-9e5f-a86d3bb94fb4 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:00.308772 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-fd7d3590-135e-4bb7-9e5f-a86d3bb94fb4 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:00.324726 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fd7d3590-135e-4bb7-9e5f-a86d3bb94fb4 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:00.333556 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fd7d3590-135e-4bb7-9e5f-a86d3bb94fb4 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:00.334492 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fd7d3590-135e-4bb7-9e5f-a86d3bb94fb4 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:00.334945 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fd7d3590-135e-4bb7-9e5f-a86d3bb94fb4 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:00.938672 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-fd7d3590-135e-4bb7-9e5f-a86d3bb94fb4 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:00.967632 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-fd7d3590-135e-4bb7-9e5f-a86d3bb94fb4 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1210 microversion: 2.1 time: 0.664306 Jun 24 09:42:00.968380 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 5/10] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:00 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1210 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:01.988727 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-e27de366-f342-4866-b9a7-b9df6add66f0 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:01.992382 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-e27de366-f342-4866-b9a7-b9df6add66f0 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:02.033869 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e27de366-f342-4866-b9a7-b9df6add66f0 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:02.034350 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e27de366-f342-4866-b9a7-b9df6add66f0 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:02.035189 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e27de366-f342-4866-b9a7-b9df6add66f0 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:02.041757 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e27de366-f342-4866-b9a7-b9df6add66f0 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:02.797273 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-e27de366-f342-4866-b9a7-b9df6add66f0 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:02.819819 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-e27de366-f342-4866-b9a7-b9df6add66f0 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1272 microversion: 2.1 time: 0.837611 Jun 24 09:42:02.825335 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 6/11] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:01 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1272 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:03.844627 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ab47de45-7bcf-411e-bbba-29025f1c14cc tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:03.846610 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ab47de45-7bcf-411e-bbba-29025f1c14cc tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:03.867428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ab47de45-7bcf-411e-bbba-29025f1c14cc tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:03.870159 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ab47de45-7bcf-411e-bbba-29025f1c14cc tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:03.872105 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ab47de45-7bcf-411e-bbba-29025f1c14cc tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:03.874706 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ab47de45-7bcf-411e-bbba-29025f1c14cc tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:04.160706 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b9dfbf14-808f-4436-a2e4-5ae85f66db7d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1996751600", "imageRef": "844ad823-18a2-4abc-813c-2d1825141591", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:42:04.242999 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ab47de45-7bcf-411e-bbba-29025f1c14cc tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:04.256092 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ab47de45-7bcf-411e-bbba-29025f1c14cc tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1272 microversion: 2.1 time: 0.421090 Jun 24 09:42:04.266248 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 7/12] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:03 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1272 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:04.480434 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.network.neutron [None req-b9dfbf14-808f-4436-a2e4-5ae85f66db7d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] validate_networks() for [('eee14dfc-24f3-458e-880d-b3e43ab7d14d', None, None, None, None, None)] {{(pid=124339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:42:05.278673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-c42a873e-1ba4-4adf-99c8-7c8da560d5f7 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:05.282558 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-c42a873e-1ba4-4adf-99c8-7c8da560d5f7 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:05.302459 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c42a873e-1ba4-4adf-99c8-7c8da560d5f7 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:05.302928 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c42a873e-1ba4-4adf-99c8-7c8da560d5f7 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:05.305443 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c42a873e-1ba4-4adf-99c8-7c8da560d5f7 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:05.305974 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c42a873e-1ba4-4adf-99c8-7c8da560d5f7 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:05.581067 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-c42a873e-1ba4-4adf-99c8-7c8da560d5f7 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:05.620568 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-c42a873e-1ba4-4adf-99c8-7c8da560d5f7 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1272 microversion: 2.1 time: 0.350021 Jun 24 09:42:05.635482 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 8/13] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:05 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1272 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:06.643065 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-476d324d-1e6b-4c3a-bde5-04790db60c95 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:06.645106 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-476d324d-1e6b-4c3a-bde5-04790db60c95 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:06.686411 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-476d324d-1e6b-4c3a-bde5-04790db60c95 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:06.693326 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-476d324d-1e6b-4c3a-bde5-04790db60c95 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:06.704300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-476d324d-1e6b-4c3a-bde5-04790db60c95 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:06.709575 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-476d324d-1e6b-4c3a-bde5-04790db60c95 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:07.032388 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=2 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:07.758654 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=2 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:08.380533 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-476d324d-1e6b-4c3a-bde5-04790db60c95 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:08.394229 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-476d324d-1e6b-4c3a-bde5-04790db60c95 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1314 microversion: 2.1 time: 1.757725 Jun 24 09:42:08.415561 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 9/14] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:06 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1314 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:09.050102 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-b9dfbf14-808f-4436-a2e4-5ae85f66db7d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Flavor limits 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:42:09.051503 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-b9dfbf14-808f-4436-a2e4-5ae85f66db7d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Image limits 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:42:09.052219 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-b9dfbf14-808f-4436-a2e4-5ae85f66db7d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Flavor pref 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:42:09.052858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-b9dfbf14-808f-4436-a2e4-5ae85f66db7d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Image pref 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:42:09.054014 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-b9dfbf14-808f-4436-a2e4-5ae85f66db7d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:42:09.125907 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b9dfbf14-808f-4436-a2e4-5ae85f66db7d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:09.128896 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b9dfbf14-808f-4436-a2e4-5ae85f66db7d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:09.130765 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b9dfbf14-808f-4436-a2e4-5ae85f66db7d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:09.133388 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b9dfbf14-808f-4436-a2e4-5ae85f66db7d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:09.233623 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-b9dfbf14-808f-4436-a2e4-5ae85f66db7d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Getting quotas for project 42946f76423740028ae43dc6a49cbbda. Resources: {'cores', 'ram', 'instances'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:42:09.259186 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-b9dfbf14-808f-4436-a2e4-5ae85f66db7d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Getting quotas for user d5e6d9fad06449c1b43254df442d224f and project 42946f76423740028ae43dc6a49cbbda. Resources: {'cores', 'ram', 'instances'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:42:09.285840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=8 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:09.312295 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-b9dfbf14-808f-4436-a2e4-5ae85f66db7d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Going to run 1 instances... {{(pid=124339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:42:09.322839 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-b9dfbf14-808f-4436-a2e4-5ae85f66db7d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='844ad823-18a2-4abc-813c-2d1825141591',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:42:09.529607 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b9dfbf14-808f-4436-a2e4-5ae85f66db7d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.202150 Jun 24 09:42:09.533497 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 6/15] 10.222.0.65 () {60 vars in 1146 bytes} [Fri Jun 24 09:42:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 6205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 09:42:09.578051 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-106b5622-aec2-402a-ab60-c3b84cea1763 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Action: 'create', calling method: .version_select at 0x7fc6d5839550>, body: {"keypair": {"name": "tempest-keypair-137888887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWiIIxrC/A7Fqy5etzEHS7cL46Z7lU1GmwKgPybqPCbY+uATDJpjCwdE7ZH3fiAqLlrhjoIL0GtSvB4qYoHniJeqy51s0myi6Ts2W7WRbISuw7uT2JRq2IzzCZkdWS36w=="}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:42:09.672207 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-106b5622-aec2-402a-ab60-c3b84cea1763 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Getting quotas for project f64a8807499a44ababb8bb037fc3d195. Resources: {'key_pairs'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:42:09.719513 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-106b5622-aec2-402a-ab60-c3b84cea1763 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Getting quotas for user 544cf118cc9e4aed8e7ec7e9dfe023bc and project f64a8807499a44ababb8bb037fc3d195. Resources: {'key_pairs'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:42:09.851681 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-106b5622-aec2-402a-ab60-c3b84cea1763 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.433844 Jun 24 09:42:09.852922 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 10/16] 10.222.0.65 () {62 vars in 1199 bytes} [Fri Jun 24 09:42:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1436 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 24 09:42:09.861025 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-dcc0356c-f377-45f4-859f-b75ffc353b8c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:09.861924 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-dcc0356c-f377-45f4-859f-b75ffc353b8c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:09.875715 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-dcc0356c-f377-45f4-859f-b75ffc353b8c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:09.876826 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-dcc0356c-f377-45f4-859f-b75ffc353b8c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:09.878189 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-dcc0356c-f377-45f4-859f-b75ffc353b8c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:09.879860 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-dcc0356c-f377-45f4-859f-b75ffc353b8c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:10.455369 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-8676b56c-3840-4c2f-8aca-dd6f06e245d8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Action: 'create', calling method: .version_select at 0x7fc6d685ab80>, body: {"keypair": {"name": "tempest-keypair-2072673669", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiZvPKiLAIKxtHuUfkucLL2SOCkNv18cYVUTaFw4fk+uaaJjrM0ZLyTB2LGkmEmBP6sxOaR/yfAsq1sG3o2Blreyhpg4ENL/5jMBohuptTYW+fu3SdMhO8Hvsaunf6iNA=="}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:42:10.585846 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-8676b56c-3840-4c2f-8aca-dd6f06e245d8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Getting quotas for project 30033ce42b5a43b78dde38163831cea2. Resources: {'key_pairs'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:42:10.635565 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-8676b56c-3840-4c2f-8aca-dd6f06e245d8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Getting quotas for user fd136fcda9a04a16b258301a86bde8ef and project 30033ce42b5a43b78dde38163831cea2. Resources: {'key_pairs'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:42:10.670487 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-dcc0356c-f377-45f4-859f-b75ffc353b8c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:10.684280 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-dcc0356c-f377-45f4-859f-b75ffc353b8c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1314 microversion: 2.1 time: 0.826202 Jun 24 09:42:10.698212 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 11/17] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:09 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1314 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:10.716534 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-906275a8-b919-45b0-9e51-11f2196177af tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:10.719619 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-906275a8-b919-45b0-9e51-11f2196177af tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:10.813735 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-8676b56c-3840-4c2f-8aca-dd6f06e245d8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.269590 Jun 24 09:42:10.823502 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 7/18] 10.222.0.65 () {60 vars in 1158 bytes} [Fri Jun 24 09:42:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:42:11.668729 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-906275a8-b919-45b0-9e51-11f2196177af tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:11.685237 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-906275a8-b919-45b0-9e51-11f2196177af tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1222 microversion: 2.1 time: 0.983797 Jun 24 09:42:11.689165 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 12/19] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:10 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1222 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:11.702197 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-8c5f3706-0897-451b-ab6e-2beee064d58c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:11.703658 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-8c5f3706-0897-451b-ab6e-2beee064d58c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:11.757915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8c5f3706-0897-451b-ab6e-2beee064d58c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:11.758599 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8c5f3706-0897-451b-ab6e-2beee064d58c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:11.759588 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8c5f3706-0897-451b-ab6e-2beee064d58c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:11.760352 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8c5f3706-0897-451b-ab6e-2beee064d58c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:12.151193 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-e6128fbd-64f8-4772-8a3e-90a4e7e41670 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-997720521", "imageRef": "844ad823-18a2-4abc-813c-2d1825141591", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:42:12.308547 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.network.neutron [None req-e6128fbd-64f8-4772-8a3e-90a4e7e41670 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] validate_networks() for [('eee14dfc-24f3-458e-880d-b3e43ab7d14d', None, None, None, None, None)] {{(pid=124338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:42:12.930331 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-8c5f3706-0897-451b-ab6e-2beee064d58c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:12.943849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-8c5f3706-0897-451b-ab6e-2beee064d58c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1314 microversion: 2.1 time: 1.245905 Jun 24 09:42:12.964549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 8/20] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:11 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1314 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:13.965191 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c5f6385c-7cb6-4ab6-ac1d-4254bd64c146 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:13.966007 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-c5f6385c-7cb6-4ab6-ac1d-4254bd64c146 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:14.026463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c5f6385c-7cb6-4ab6-ac1d-4254bd64c146 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:14.026917 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c5f6385c-7cb6-4ab6-ac1d-4254bd64c146 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:14.040982 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c5f6385c-7cb6-4ab6-ac1d-4254bd64c146 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:14.049841 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c5f6385c-7cb6-4ab6-ac1d-4254bd64c146 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:15.887216 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c5f6385c-7cb6-4ab6-ac1d-4254bd64c146 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:15.941850 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-c5f6385c-7cb6-4ab6-ac1d-4254bd64c146 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1314 microversion: 2.1 time: 1.979824 Jun 24 09:42:15.942514 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 9/21] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:13 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1314 bytes in 1983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:42:16.411508 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-e6128fbd-64f8-4772-8a3e-90a4e7e41670 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Flavor limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:42:16.412153 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-e6128fbd-64f8-4772-8a3e-90a4e7e41670 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Image limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:42:16.412393 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-e6128fbd-64f8-4772-8a3e-90a4e7e41670 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Flavor pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:42:16.413578 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-e6128fbd-64f8-4772-8a3e-90a4e7e41670 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Image pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:42:16.414157 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-e6128fbd-64f8-4772-8a3e-90a4e7e41670 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:42:16.416487 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:16.433110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e6128fbd-64f8-4772-8a3e-90a4e7e41670 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:16.433566 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e6128fbd-64f8-4772-8a3e-90a4e7e41670 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:16.436562 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e6128fbd-64f8-4772-8a3e-90a4e7e41670 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:16.437563 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e6128fbd-64f8-4772-8a3e-90a4e7e41670 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:16.440508 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-a531f7f0-52e7-4176-97fa-2c145dc3f830 req-d0ea841f-7b9a-4fb7-84b8-f48d4c1e3be3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce878530-09af-4e67-9276-7b448c325d2f", "tag": "697f8edd-0704-4e42-8528-68705e30c6e2"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:42:16.457646 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-a531f7f0-52e7-4176-97fa-2c145dc3f830 req-d0ea841f-7b9a-4fb7-84b8-f48d4c1e3be3 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:16.458403 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-a531f7f0-52e7-4176-97fa-2c145dc3f830 req-d0ea841f-7b9a-4fb7-84b8-f48d4c1e3be3 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:16.509571 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-e6128fbd-64f8-4772-8a3e-90a4e7e41670 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Getting quotas for project 42946f76423740028ae43dc6a49cbbda. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:42:16.520109 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-e6128fbd-64f8-4772-8a3e-90a4e7e41670 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Getting quotas for user d5e6d9fad06449c1b43254df442d224f and project 42946f76423740028ae43dc6a49cbbda. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:42:16.531732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-a531f7f0-52e7-4176-97fa-2c145dc3f830 req-d0ea841f-7b9a-4fb7-84b8-f48d4c1e3be3 service nova] Creating event network-changed:697f8edd-0704-4e42-8528-68705e30c6e2 for instance ce878530-09af-4e67-9276-7b448c325d2f on hv-cinder-80382 Jun 24 09:42:16.532274 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-a531f7f0-52e7-4176-97fa-2c145dc3f830 req-d0ea841f-7b9a-4fb7-84b8-f48d4c1e3be3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124339) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 24 09:42:16.533382 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-499a8ba2-c0c7-409f-bd2e-002fa44eca89 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:16.533818 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-499a8ba2-c0c7-409f-bd2e-002fa44eca89 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:16.536858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-499a8ba2-c0c7-409f-bd2e-002fa44eca89 None None] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:16.537000 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-e6128fbd-64f8-4772-8a3e-90a4e7e41670 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Going to run 1 instances... {{(pid=124338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:42:16.540940 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-499a8ba2-c0c7-409f-bd2e-002fa44eca89 None None] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:16.547219 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-e6128fbd-64f8-4772-8a3e-90a4e7e41670 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='844ad823-18a2-4abc-813c-2d1825141591',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:42:16.575269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.compute.rpcapi [None req-499a8ba2-c0c7-409f-bd2e-002fa44eca89 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 24 09:42:16.579702 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-499a8ba2-c0c7-409f-bd2e-002fa44eca89 None None] Releasing lock "compute-rpcapi-router" {{(pid=124339) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 24 09:42:16.623131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-499a8ba2-c0c7-409f-bd2e-002fa44eca89 None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.658006 Jun 24 09:42:16.623766 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 10/22] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:42:16.629665 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-fc5bbb48-7bd2-4afd-9655-616ea5183fd3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1153774108", "imageRef": "844ad823-18a2-4abc-813c-2d1825141591", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c0ea8d6-2f6d-4edc-b8f1-5cfa8ccc4f6b"}], "security_groups": [{"name": "tempest-securitygroup--623916994"}], "key_name": "tempest-keypair-137888887", "user_data": "}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:42:16.703972 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-e6128fbd-64f8-4772-8a3e-90a4e7e41670 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.559753 Jun 24 09:42:16.704650 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 13/23] 10.222.0.65 () {60 vars in 1146 bytes} [Fri Jun 24 09:42:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 4561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 09:42:16.728489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-36439d9e-7243-464c-a3fd-4e7c62876711 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:16.729115 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-36439d9e-7243-464c-a3fd-4e7c62876711 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:16.886382 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-36439d9e-7243-464c-a3fd-4e7c62876711 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:16.896346 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-36439d9e-7243-464c-a3fd-4e7c62876711 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1221 microversion: 2.1 time: 0.171991 Jun 24 09:42:16.896941 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 14/24] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:16 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1221 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:16.960897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-21d66a40-ea40-45a3-bc1e-0a7966ea9e2c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:16.961969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-21d66a40-ea40-45a3-bc1e-0a7966ea9e2c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:16.973610 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-21d66a40-ea40-45a3-bc1e-0a7966ea9e2c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:16.975905 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-21d66a40-ea40-45a3-bc1e-0a7966ea9e2c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:16.980187 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-21d66a40-ea40-45a3-bc1e-0a7966ea9e2c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:16.981884 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-21d66a40-ea40-45a3-bc1e-0a7966ea9e2c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:17.149454 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.network.neutron [None req-fc5bbb48-7bd2-4afd-9655-616ea5183fd3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] validate_networks() for [('8c0ea8d6-2f6d-4edc-b8f1-5cfa8ccc4f6b', None, None, None, None, None)] {{(pid=124339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:42:17.888434 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-21d66a40-ea40-45a3-bc1e-0a7966ea9e2c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:17.906086 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-21d66a40-ea40-45a3-bc1e-0a7966ea9e2c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1314 microversion: 2.1 time: 0.949999 Jun 24 09:42:17.918716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 15/25] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:16 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1314 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:17.925968 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ec874eff-beed-474e-89a8-9a170a0dd380 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:17.926598 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ec874eff-beed-474e-89a8-9a170a0dd380 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:17.936827 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ec874eff-beed-474e-89a8-9a170a0dd380 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:17.937515 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ec874eff-beed-474e-89a8-9a170a0dd380 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:17.938600 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ec874eff-beed-474e-89a8-9a170a0dd380 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:17.939234 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ec874eff-beed-474e-89a8-9a170a0dd380 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:18.754228 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ec874eff-beed-474e-89a8-9a170a0dd380 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:18.766525 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ec874eff-beed-474e-89a8-9a170a0dd380 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1225 microversion: 2.1 time: 0.846181 Jun 24 09:42:18.778440 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 16/26] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:17 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1225 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:18.926549 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-d5b6a1d9-b8fb-45a5-b013-f85ea93addb9 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:18.927301 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-d5b6a1d9-b8fb-45a5-b013-f85ea93addb9 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:18.945929 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d5b6a1d9-b8fb-45a5-b013-f85ea93addb9 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:18.950169 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d5b6a1d9-b8fb-45a5-b013-f85ea93addb9 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:18.956410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d5b6a1d9-b8fb-45a5-b013-f85ea93addb9 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:18.956996 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d5b6a1d9-b8fb-45a5-b013-f85ea93addb9 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:19.014461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=4 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:19.322990 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d5b6a1d9-b8fb-45a5-b013-f85ea93addb9 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:19.334426 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-d5b6a1d9-b8fb-45a5-b013-f85ea93addb9 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1314 microversion: 2.1 time: 0.413161 Jun 24 09:42:19.343009 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 17/27] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:18 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:19.620776 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-fc5bbb48-7bd2-4afd-9655-616ea5183fd3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Flavor limits 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:42:19.621381 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-fc5bbb48-7bd2-4afd-9655-616ea5183fd3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Image limits 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:42:19.621933 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-fc5bbb48-7bd2-4afd-9655-616ea5183fd3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Flavor pref 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:42:19.622413 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-fc5bbb48-7bd2-4afd-9655-616ea5183fd3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Image pref 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:42:19.622898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-fc5bbb48-7bd2-4afd-9655-616ea5183fd3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:42:19.641358 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fc5bbb48-7bd2-4afd-9655-616ea5183fd3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:19.643754 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fc5bbb48-7bd2-4afd-9655-616ea5183fd3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:19.645395 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fc5bbb48-7bd2-4afd-9655-616ea5183fd3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:19.646625 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fc5bbb48-7bd2-4afd-9655-616ea5183fd3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:19.670315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-fc5bbb48-7bd2-4afd-9655-616ea5183fd3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Getting quotas for project f64a8807499a44ababb8bb037fc3d195. Resources: {'cores', 'ram', 'instances'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:42:19.675302 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-fc5bbb48-7bd2-4afd-9655-616ea5183fd3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Getting quotas for user 544cf118cc9e4aed8e7ec7e9dfe023bc and project f64a8807499a44ababb8bb037fc3d195. Resources: {'cores', 'ram', 'instances'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:42:19.690560 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-fc5bbb48-7bd2-4afd-9655-616ea5183fd3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Going to run 1 instances... {{(pid=124339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:42:19.693665 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-fc5bbb48-7bd2-4afd-9655-616ea5183fd3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='844ad823-18a2-4abc-813c-2d1825141591',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:42:19.751444 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-fc5bbb48-7bd2-4afd-9655-616ea5183fd3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.126369 Jun 24 09:42:19.754531 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 11/28] 10.222.0.65 () {62 vars in 1187 bytes} [Fri Jun 24 09:42:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 3130 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 24 09:42:19.769945 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-f1e59a6c-6fa7-4bb7-a408-4ca1899577e4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:19.770894 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-f1e59a6c-6fa7-4bb7-a408-4ca1899577e4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:19.806214 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-6fcfd1ff-1608-4177-a217-01c8f1b6e017 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:19.831676 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-6fcfd1ff-1608-4177-a217-01c8f1b6e017 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:19.871592 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6fcfd1ff-1608-4177-a217-01c8f1b6e017 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:19.877098 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6fcfd1ff-1608-4177-a217-01c8f1b6e017 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:19.878315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6fcfd1ff-1608-4177-a217-01c8f1b6e017 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:19.879853 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6fcfd1ff-1608-4177-a217-01c8f1b6e017 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:19.996120 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f1e59a6c-6fa7-4bb7-a408-4ca1899577e4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:20.015437 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f1e59a6c-6fa7-4bb7-a408-4ca1899577e4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:20.017485 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f1e59a6c-6fa7-4bb7-a408-4ca1899577e4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:20.019003 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-f1e59a6c-6fa7-4bb7-a408-4ca1899577e4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1281 microversion: 2.20 time: 0.258040 Jun 24 09:42:20.019753 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 18/29] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:42:19 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1281 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:42:20.035411 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-d4124480-4e89-4c5d-8d74-9606c1b4c59c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-820589373", "imageRef": "844ad823-18a2-4abc-813c-2d1825141591", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6d825bf-3025-4144-aa4c-5693ec78fffa"}], "security_groups": [{"name": "tempest-securitygroup--1192884519"}], "key_name": "tempest-keypair-2072673669", "user_data": "}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:42:20.091318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6fcfd1ff-1608-4177-a217-01c8f1b6e017 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:20.100318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-6fcfd1ff-1608-4177-a217-01c8f1b6e017 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1225 microversion: 2.1 time: 0.319269 Jun 24 09:42:20.101372 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 12/30] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:19 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1225 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:20.207160 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.network.neutron [None req-d4124480-4e89-4c5d-8d74-9606c1b4c59c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] validate_networks() for [('d6d825bf-3025-4144-aa4c-5693ec78fffa', None, None, None, None, None)] {{(pid=124338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:42:20.360576 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-49ecac04-40cf-4811-b8f7-5d267a97e5ee tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:20.361101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-49ecac04-40cf-4811-b8f7-5d267a97e5ee tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:20.372773 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-49ecac04-40cf-4811-b8f7-5d267a97e5ee tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:20.375287 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-49ecac04-40cf-4811-b8f7-5d267a97e5ee tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:20.377448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-49ecac04-40cf-4811-b8f7-5d267a97e5ee tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:20.380891 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-49ecac04-40cf-4811-b8f7-5d267a97e5ee tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:20.884472 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-49ecac04-40cf-4811-b8f7-5d267a97e5ee tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:20.902849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-49ecac04-40cf-4811-b8f7-5d267a97e5ee tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1314 microversion: 2.1 time: 0.548160 Jun 24 09:42:20.904612 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 13/31] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:20 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:21.074257 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e5fb6eef-28f6-4c14-bd5e-43dc7bc52353 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:21.075473 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e5fb6eef-28f6-4c14-bd5e-43dc7bc52353 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:21.102762 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e5fb6eef-28f6-4c14-bd5e-43dc7bc52353 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:21.105453 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e5fb6eef-28f6-4c14-bd5e-43dc7bc52353 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:21.108062 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-d4124480-4e89-4c5d-8d74-9606c1b4c59c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Flavor limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:42:21.108836 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-d4124480-4e89-4c5d-8d74-9606c1b4c59c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Image limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:42:21.109526 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-d4124480-4e89-4c5d-8d74-9606c1b4c59c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Flavor pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:42:21.110130 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e5fb6eef-28f6-4c14-bd5e-43dc7bc52353 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:21.110307 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-d4124480-4e89-4c5d-8d74-9606c1b4c59c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Image pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:42:21.110630 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-d4124480-4e89-4c5d-8d74-9606c1b4c59c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:42:21.111720 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e5fb6eef-28f6-4c14-bd5e-43dc7bc52353 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:21.158093 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d4124480-4e89-4c5d-8d74-9606c1b4c59c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:21.161456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d4124480-4e89-4c5d-8d74-9606c1b4c59c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:21.169147 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d4124480-4e89-4c5d-8d74-9606c1b4c59c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:21.170570 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d4124480-4e89-4c5d-8d74-9606c1b4c59c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:21.296813 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e5fb6eef-28f6-4c14-bd5e-43dc7bc52353 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:21.314475 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e5fb6eef-28f6-4c14-bd5e-43dc7bc52353 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:21.316092 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e5fb6eef-28f6-4c14-bd5e-43dc7bc52353 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:21.317432 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e5fb6eef-28f6-4c14-bd5e-43dc7bc52353 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1285 microversion: 2.20 time: 0.278101 Jun 24 09:42:21.326355 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 14/32] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:42:21 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1285 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:42:21.343871 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-d2f6df8d-5c34-42f1-ad68-ab283c22073e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:21.345435 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-d4124480-4e89-4c5d-8d74-9606c1b4c59c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Getting quotas for project 30033ce42b5a43b78dde38163831cea2. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:42:21.350975 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-d2f6df8d-5c34-42f1-ad68-ab283c22073e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:21.375734 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d2f6df8d-5c34-42f1-ad68-ab283c22073e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:21.381352 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d2f6df8d-5c34-42f1-ad68-ab283c22073e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:21.384982 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d2f6df8d-5c34-42f1-ad68-ab283c22073e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:21.386232 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d2f6df8d-5c34-42f1-ad68-ab283c22073e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:21.392874 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-d4124480-4e89-4c5d-8d74-9606c1b4c59c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Getting quotas for user fd136fcda9a04a16b258301a86bde8ef and project 30033ce42b5a43b78dde38163831cea2. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:42:21.474421 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-d4124480-4e89-4c5d-8d74-9606c1b4c59c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Going to run 1 instances... {{(pid=124338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:42:21.482984 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-d4124480-4e89-4c5d-8d74-9606c1b4c59c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='844ad823-18a2-4abc-813c-2d1825141591',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:42:21.667330 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-d2f6df8d-5c34-42f1-ad68-ab283c22073e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:21.678534 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-d2f6df8d-5c34-42f1-ad68-ab283c22073e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1225 microversion: 2.1 time: 0.350532 Jun 24 09:42:21.688023 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 15/33] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:21 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1225 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:21.768143 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-d4124480-4e89-4c5d-8d74-9606c1b4c59c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.742183 Jun 24 09:42:21.769626 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 19/34] 10.222.0.65 () {60 vars in 1146 bytes} [Fri Jun 24 09:42:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 09:42:21.782539 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-08150c66-3549-4e57-9932-92ed85eaa739 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:21.783947 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-08150c66-3549-4e57-9932-92ed85eaa739 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:21.922153 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-d6eac5bc-165d-40cf-9be4-e2802bc23bee tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:21.922980 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-d6eac5bc-165d-40cf-9be4-e2802bc23bee tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:21.934158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d6eac5bc-165d-40cf-9be4-e2802bc23bee tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:21.939810 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d6eac5bc-165d-40cf-9be4-e2802bc23bee tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:21.944699 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d6eac5bc-165d-40cf-9be4-e2802bc23bee tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:21.945501 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d6eac5bc-165d-40cf-9be4-e2802bc23bee tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:22.832376 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-08150c66-3549-4e57-9932-92ed85eaa739 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:22.842410 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-08150c66-3549-4e57-9932-92ed85eaa739 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1241 microversion: 2.1 time: 1.065699 Jun 24 09:42:22.843007 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 16/35] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:21 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1241 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:22.887785 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-6058fd15-6788-4c5e-bbe1-a4b18e10bb58 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:22.888539 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-6058fd15-6788-4c5e-bbe1-a4b18e10bb58 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:22.921658 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6058fd15-6788-4c5e-bbe1-a4b18e10bb58 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:22.926908 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6058fd15-6788-4c5e-bbe1-a4b18e10bb58 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:22.931453 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6058fd15-6788-4c5e-bbe1-a4b18e10bb58 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:22.931940 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6058fd15-6788-4c5e-bbe1-a4b18e10bb58 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:23.269441 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6058fd15-6788-4c5e-bbe1-a4b18e10bb58 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:23.321863 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d6eac5bc-165d-40cf-9be4-e2802bc23bee tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:23.329137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6058fd15-6788-4c5e-bbe1-a4b18e10bb58 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:23.329137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6058fd15-6788-4c5e-bbe1-a4b18e10bb58 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:23.331144 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-6058fd15-6788-4c5e-bbe1-a4b18e10bb58 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1333 microversion: 2.20 time: 0.471231 Jun 24 09:42:23.332862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 17/36] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:42:22 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1333 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:42:23.348831 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-d6eac5bc-165d-40cf-9be4-e2802bc23bee tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1314 microversion: 2.1 time: 1.430055 Jun 24 09:42:23.351967 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 20/37] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:21 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1314 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:23.359763 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-2630f11c-f94b-4c26-a64a-4e8551b7439f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:23.362892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-2630f11c-f94b-4c26-a64a-4e8551b7439f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:23.372363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2630f11c-f94b-4c26-a64a-4e8551b7439f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:23.373080 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2630f11c-f94b-4c26-a64a-4e8551b7439f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:23.374658 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2630f11c-f94b-4c26-a64a-4e8551b7439f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:23.375307 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2630f11c-f94b-4c26-a64a-4e8551b7439f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:23.861582 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7544c749-b0f5-4f7f-9584-92a68b4f1459 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:23.862388 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-7544c749-b0f5-4f7f-9584-92a68b4f1459 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:23.882424 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7544c749-b0f5-4f7f-9584-92a68b4f1459 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:23.885709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7544c749-b0f5-4f7f-9584-92a68b4f1459 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:23.886655 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7544c749-b0f5-4f7f-9584-92a68b4f1459 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:23.893123 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7544c749-b0f5-4f7f-9584-92a68b4f1459 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:24.159025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-2630f11c-f94b-4c26-a64a-4e8551b7439f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:24.160007 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-7544c749-b0f5-4f7f-9584-92a68b4f1459 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:24.172525 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-7544c749-b0f5-4f7f-9584-92a68b4f1459 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1237 microversion: 2.1 time: 0.315959 Jun 24 09:42:24.173864 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 21/38] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:23 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1237 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:42:24.186478 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-2630f11c-f94b-4c26-a64a-4e8551b7439f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1281 microversion: 2.1 time: 0.839758 Jun 24 09:42:24.188041 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 18/39] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:23 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1281 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:24.355910 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-175c9308-db64-42b6-ac71-a448093e494c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:24.356548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-175c9308-db64-42b6-ac71-a448093e494c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:24.377099 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-175c9308-db64-42b6-ac71-a448093e494c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:24.378188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-175c9308-db64-42b6-ac71-a448093e494c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:24.379330 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-d09a558b-ed44-4e46-8eb4-c5f7d315e54e tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:24.381195 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-d09a558b-ed44-4e46-8eb4-c5f7d315e54e tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:24.383204 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-175c9308-db64-42b6-ac71-a448093e494c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:24.385315 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-175c9308-db64-42b6-ac71-a448093e494c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:24.405015 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d09a558b-ed44-4e46-8eb4-c5f7d315e54e tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:24.405015 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d09a558b-ed44-4e46-8eb4-c5f7d315e54e tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:24.407833 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=67 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:24.419902 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d09a558b-ed44-4e46-8eb4-c5f7d315e54e tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:24.423773 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d09a558b-ed44-4e46-8eb4-c5f7d315e54e tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:24.529480 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-175c9308-db64-42b6-ac71-a448093e494c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:24.552720 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-175c9308-db64-42b6-ac71-a448093e494c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:24.558268 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-175c9308-db64-42b6-ac71-a448093e494c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:24.566918 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-175c9308-db64-42b6-ac71-a448093e494c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1339 microversion: 2.20 time: 0.213758 Jun 24 09:42:24.575176 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 22/40] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:42:24 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1339 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:42:24.864631 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-d09a558b-ed44-4e46-8eb4-c5f7d315e54e tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:24.873252 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-d09a558b-ed44-4e46-8eb4-c5f7d315e54e tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1314 microversion: 2.1 time: 0.509254 Jun 24 09:42:24.876882 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 19/41] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:24 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1314 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:25.194667 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-bb580484-5024-4935-a199-e2b485a9b6f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:25.195389 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-bb580484-5024-4935-a199-e2b485a9b6f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:25.206058 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-302a0b6b-a5ff-4424-addc-9aaf7d27cd28 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:25.207454 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-302a0b6b-a5ff-4424-addc-9aaf7d27cd28 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:25.228863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-302a0b6b-a5ff-4424-addc-9aaf7d27cd28 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:25.229356 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-302a0b6b-a5ff-4424-addc-9aaf7d27cd28 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:25.230996 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-bb580484-5024-4935-a199-e2b485a9b6f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:25.231475 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-bb580484-5024-4935-a199-e2b485a9b6f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:25.232919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-302a0b6b-a5ff-4424-addc-9aaf7d27cd28 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:25.233612 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-302a0b6b-a5ff-4424-addc-9aaf7d27cd28 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:25.234802 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-bb580484-5024-4935-a199-e2b485a9b6f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:25.236090 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-bb580484-5024-4935-a199-e2b485a9b6f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:25.360367 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-bb580484-5024-4935-a199-e2b485a9b6f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:25.372503 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-bb580484-5024-4935-a199-e2b485a9b6f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1301 microversion: 2.1 time: 0.185094 Jun 24 09:42:25.375821 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 23/42] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:25 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1301 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:25.403268 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-302a0b6b-a5ff-4424-addc-9aaf7d27cd28 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:25.412015 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-302a0b6b-a5ff-4424-addc-9aaf7d27cd28 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1279 microversion: 2.1 time: 0.210677 Jun 24 09:42:25.414003 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 20/43] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:25 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1279 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:25.590101 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-d2a5184e-4e51-4417-b15c-4911b22ca8c4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:25.590884 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-d2a5184e-4e51-4417-b15c-4911b22ca8c4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:25.598126 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d2a5184e-4e51-4417-b15c-4911b22ca8c4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:25.598658 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d2a5184e-4e51-4417-b15c-4911b22ca8c4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:25.599538 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d2a5184e-4e51-4417-b15c-4911b22ca8c4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:25.600442 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d2a5184e-4e51-4417-b15c-4911b22ca8c4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:25.679352 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d2a5184e-4e51-4417-b15c-4911b22ca8c4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:25.691119 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d2a5184e-4e51-4417-b15c-4911b22ca8c4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:25.694278 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d2a5184e-4e51-4417-b15c-4911b22ca8c4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:25.696712 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-d2a5184e-4e51-4417-b15c-4911b22ca8c4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1339 microversion: 2.20 time: 0.111065 Jun 24 09:42:25.697723 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 24/44] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:42:25 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1339 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:42:25.893959 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-bff4f67a-d468-4d10-879c-6e81c0af918f tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:25.894633 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-bff4f67a-d468-4d10-879c-6e81c0af918f tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:25.901888 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bff4f67a-d468-4d10-879c-6e81c0af918f tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:25.902612 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bff4f67a-d468-4d10-879c-6e81c0af918f tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:25.903426 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bff4f67a-d468-4d10-879c-6e81c0af918f tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:25.903942 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bff4f67a-d468-4d10-879c-6e81c0af918f tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:26.391965 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-d1a11348-28a0-4e2f-a9dd-4470a5873a7a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:26.393632 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-d1a11348-28a0-4e2f-a9dd-4470a5873a7a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:26.408329 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d1a11348-28a0-4e2f-a9dd-4470a5873a7a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:26.409074 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d1a11348-28a0-4e2f-a9dd-4470a5873a7a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:26.410067 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d1a11348-28a0-4e2f-a9dd-4470a5873a7a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:26.410792 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d1a11348-28a0-4e2f-a9dd-4470a5873a7a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:26.433473 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-bff4f67a-d468-4d10-879c-6e81c0af918f tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:26.447539 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-bff4f67a-d468-4d10-879c-6e81c0af918f tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1314 microversion: 2.1 time: 0.555670 Jun 24 09:42:26.449848 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 21/45] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:25 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:26.460677 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f34fc136-fcb6-4908-acbb-bba096de8d0c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:26.463892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-f34fc136-fcb6-4908-acbb-bba096de8d0c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:26.480175 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f34fc136-fcb6-4908-acbb-bba096de8d0c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:26.480406 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f34fc136-fcb6-4908-acbb-bba096de8d0c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:26.481211 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f34fc136-fcb6-4908-acbb-bba096de8d0c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:26.482859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f34fc136-fcb6-4908-acbb-bba096de8d0c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:26.674597 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d1a11348-28a0-4e2f-a9dd-4470a5873a7a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:26.692212 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-d1a11348-28a0-4e2f-a9dd-4470a5873a7a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1299 microversion: 2.1 time: 0.304307 Jun 24 09:42:26.693947 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 25/46] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:26 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1299 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:42:26.719322 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-1ac6e05c-15e2-413a-8ea6-4b94f49c11f3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:26.720205 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-1ac6e05c-15e2-413a-8ea6-4b94f49c11f3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:26.730659 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1ac6e05c-15e2-413a-8ea6-4b94f49c11f3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:26.731241 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1ac6e05c-15e2-413a-8ea6-4b94f49c11f3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:26.732706 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1ac6e05c-15e2-413a-8ea6-4b94f49c11f3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:26.734664 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1ac6e05c-15e2-413a-8ea6-4b94f49c11f3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:26.886697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-f34fc136-fcb6-4908-acbb-bba096de8d0c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:26.897811 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f34fc136-fcb6-4908-acbb-bba096de8d0c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1321 microversion: 2.1 time: 0.444781 Jun 24 09:42:26.901701 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 22/47] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:26 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1321 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:27.048184 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-1ac6e05c-15e2-413a-8ea6-4b94f49c11f3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:27.063796 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-1ac6e05c-15e2-413a-8ea6-4b94f49c11f3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:27.065469 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-1ac6e05c-15e2-413a-8ea6-4b94f49c11f3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:27.068661 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-1ac6e05c-15e2-413a-8ea6-4b94f49c11f3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1406 microversion: 2.20 time: 0.354869 Jun 24 09:42:27.069681 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 26/48] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:42:26 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1406 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:42:27.467943 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-bdaef3dd-ab29-436b-8fef-8619a9cf3678 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:27.467943 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-bdaef3dd-ab29-436b-8fef-8619a9cf3678 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:27.482974 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-94448502-e6cd-4759-b5d8-e41cba308e55 req-9f0869f8-ce7b-4647-aca7-8b601b8abbde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2135f6c7-0718-46fa-94a8-f948e487e37f", "tag": "70b66b36-bc61-4e7d-8b33-ed840e49fe68"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:42:27.489235 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bdaef3dd-ab29-436b-8fef-8619a9cf3678 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:27.490716 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bdaef3dd-ab29-436b-8fef-8619a9cf3678 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:27.491556 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bdaef3dd-ab29-436b-8fef-8619a9cf3678 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:27.492079 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bdaef3dd-ab29-436b-8fef-8619a9cf3678 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:27.507538 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-94448502-e6cd-4759-b5d8-e41cba308e55 req-9f0869f8-ce7b-4647-aca7-8b601b8abbde service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:27.508031 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-94448502-e6cd-4759-b5d8-e41cba308e55 req-9f0869f8-ce7b-4647-aca7-8b601b8abbde service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:27.556333 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-94448502-e6cd-4759-b5d8-e41cba308e55 req-9f0869f8-ce7b-4647-aca7-8b601b8abbde service nova] Creating event network-changed:70b66b36-bc61-4e7d-8b33-ed840e49fe68 for instance 2135f6c7-0718-46fa-94a8-f948e487e37f on hv-cinder-80382 Jun 24 09:42:27.557121 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-94448502-e6cd-4759-b5d8-e41cba308e55 req-9f0869f8-ce7b-4647-aca7-8b601b8abbde service nova] Acquired lock "compute-rpcapi-router" {{(pid=124338) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 24 09:42:27.558506 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fd92951f-87a0-46cb-a925-dd02a2034a56 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:27.559281 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fd92951f-87a0-46cb-a925-dd02a2034a56 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:27.560393 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fd92951f-87a0-46cb-a925-dd02a2034a56 None None] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:27.561181 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fd92951f-87a0-46cb-a925-dd02a2034a56 None None] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:27.571865 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.compute.rpcapi [None req-fd92951f-87a0-46cb-a925-dd02a2034a56 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 24 09:42:27.572782 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fd92951f-87a0-46cb-a925-dd02a2034a56 None None] Releasing lock "compute-rpcapi-router" {{(pid=124338) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 24 09:42:27.602466 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-fd92951f-87a0-46cb-a925-dd02a2034a56 None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123366 Jun 24 09:42:27.603150 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 27/49] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:42:27.684691 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-bdaef3dd-ab29-436b-8fef-8619a9cf3678 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:27.693053 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-bdaef3dd-ab29-436b-8fef-8619a9cf3678 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1314 microversion: 2.1 time: 0.231557 Jun 24 09:42:27.693642 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 23/50] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:27 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:27.713539 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-0c215a9e-e9fe-49e7-b8be-d3b3267b0312 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:27.714424 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-0c215a9e-e9fe-49e7-b8be-d3b3267b0312 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:27.723842 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0c215a9e-e9fe-49e7-b8be-d3b3267b0312 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:27.724322 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0c215a9e-e9fe-49e7-b8be-d3b3267b0312 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:27.725335 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0c215a9e-e9fe-49e7-b8be-d3b3267b0312 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:27.726228 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0c215a9e-e9fe-49e7-b8be-d3b3267b0312 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:27.807345 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-0c215a9e-e9fe-49e7-b8be-d3b3267b0312 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:27.815113 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-0c215a9e-e9fe-49e7-b8be-d3b3267b0312 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1299 microversion: 2.1 time: 0.108549 Jun 24 09:42:27.821822 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 28/51] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:27 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:27.918035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-17f411fe-4345-47f7-9aa6-52fc7e58a017 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:27.918662 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-17f411fe-4345-47f7-9aa6-52fc7e58a017 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:27.924826 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-17f411fe-4345-47f7-9aa6-52fc7e58a017 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:27.925278 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-17f411fe-4345-47f7-9aa6-52fc7e58a017 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:27.926048 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-17f411fe-4345-47f7-9aa6-52fc7e58a017 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:27.926483 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-17f411fe-4345-47f7-9aa6-52fc7e58a017 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:28.062474 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-17f411fe-4345-47f7-9aa6-52fc7e58a017 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:28.070194 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-17f411fe-4345-47f7-9aa6-52fc7e58a017 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1321 microversion: 2.1 time: 0.156196 Jun 24 09:42:28.071628 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 24/52] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:27 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:42:28.087637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-964a15b1-4e1d-4faf-85e6-86c9faf9fd2d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:28.088350 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-964a15b1-4e1d-4faf-85e6-86c9faf9fd2d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:28.096184 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-964a15b1-4e1d-4faf-85e6-86c9faf9fd2d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:28.096600 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-964a15b1-4e1d-4faf-85e6-86c9faf9fd2d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:28.097705 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-964a15b1-4e1d-4faf-85e6-86c9faf9fd2d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:28.098272 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-964a15b1-4e1d-4faf-85e6-86c9faf9fd2d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:28.236132 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-964a15b1-4e1d-4faf-85e6-86c9faf9fd2d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:28.245241 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-964a15b1-4e1d-4faf-85e6-86c9faf9fd2d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:28.246761 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-964a15b1-4e1d-4faf-85e6-86c9faf9fd2d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:28.247887 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-964a15b1-4e1d-4faf-85e6-86c9faf9fd2d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1406 microversion: 2.20 time: 0.164784 Jun 24 09:42:28.248440 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 29/53] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:42:28 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:42:28.714671 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a27fd55a-ac5d-4a87-96e7-9a83b5d44fd5 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:28.716373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-a27fd55a-ac5d-4a87-96e7-9a83b5d44fd5 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:28.740772 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a27fd55a-ac5d-4a87-96e7-9a83b5d44fd5 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:28.743629 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a27fd55a-ac5d-4a87-96e7-9a83b5d44fd5 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:28.744706 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a27fd55a-ac5d-4a87-96e7-9a83b5d44fd5 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:28.745276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a27fd55a-ac5d-4a87-96e7-9a83b5d44fd5 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:28.757829 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=100 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:28.838313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-58898921-9d7b-4b09-9317-2f0f5ce02e5b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:28.849276 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-58898921-9d7b-4b09-9317-2f0f5ce02e5b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:28.850619 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-58898921-9d7b-4b09-9317-2f0f5ce02e5b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:28.852651 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-58898921-9d7b-4b09-9317-2f0f5ce02e5b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:28.856218 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-58898921-9d7b-4b09-9317-2f0f5ce02e5b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:28.856218 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-58898921-9d7b-4b09-9317-2f0f5ce02e5b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:29.258003 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-58898921-9d7b-4b09-9317-2f0f5ce02e5b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:29.272229 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-58898921-9d7b-4b09-9317-2f0f5ce02e5b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1299 microversion: 2.1 time: 0.443385 Jun 24 09:42:29.274212 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 30/54] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:28 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1299 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:29.288267 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-421a37ca-3e7d-45d3-8651-51763ab26ed4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:29.289219 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-421a37ca-3e7d-45d3-8651-51763ab26ed4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:29.303351 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-421a37ca-3e7d-45d3-8651-51763ab26ed4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:29.308102 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-421a37ca-3e7d-45d3-8651-51763ab26ed4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:29.309600 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-421a37ca-3e7d-45d3-8651-51763ab26ed4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:29.310224 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-421a37ca-3e7d-45d3-8651-51763ab26ed4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:29.659872 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=6 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:30.371632 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-a27fd55a-ac5d-4a87-96e7-9a83b5d44fd5 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:30.388764 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-a27fd55a-ac5d-4a87-96e7-9a83b5d44fd5 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1314 microversion: 2.1 time: 1.681508 Jun 24 09:42:30.398019 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 25/55] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:28 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1314 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:30.415110 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-0c9e939d-c51f-4ec5-9f60-70bf32da6e6b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:30.416388 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-0c9e939d-c51f-4ec5-9f60-70bf32da6e6b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:30.421702 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-421a37ca-3e7d-45d3-8651-51763ab26ed4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:30.439396 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-421a37ca-3e7d-45d3-8651-51763ab26ed4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1321 microversion: 2.1 time: 1.163024 Jun 24 09:42:30.442206 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0c9e939d-c51f-4ec5-9f60-70bf32da6e6b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:30.447256 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0c9e939d-c51f-4ec5-9f60-70bf32da6e6b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:30.448214 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0c9e939d-c51f-4ec5-9f60-70bf32da6e6b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:30.448667 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0c9e939d-c51f-4ec5-9f60-70bf32da6e6b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:30.457447 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 31/56] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:29 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1321 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:30.479802 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ce6ac234-49c8-47c5-94be-53b8a36692cc tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:30.480722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ce6ac234-49c8-47c5-94be-53b8a36692cc tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:30.488601 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ce6ac234-49c8-47c5-94be-53b8a36692cc tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:30.489591 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ce6ac234-49c8-47c5-94be-53b8a36692cc tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:30.490883 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ce6ac234-49c8-47c5-94be-53b8a36692cc tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:30.491774 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ce6ac234-49c8-47c5-94be-53b8a36692cc tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:30.650538 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ce6ac234-49c8-47c5-94be-53b8a36692cc tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:30.659067 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ce6ac234-49c8-47c5-94be-53b8a36692cc tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1299 microversion: 2.1 time: 0.200191 Jun 24 09:42:30.671447 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 32/57] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:30 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1299 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:30.818919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-0c9e939d-c51f-4ec5-9f60-70bf32da6e6b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:30.832631 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-0c9e939d-c51f-4ec5-9f60-70bf32da6e6b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:30.836871 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-0c9e939d-c51f-4ec5-9f60-70bf32da6e6b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:30.842032 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-0c9e939d-c51f-4ec5-9f60-70bf32da6e6b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1406 microversion: 2.20 time: 0.448143 Jun 24 09:42:30.842887 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 26/58] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:42:30 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1406 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:42:31.199892 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-c95ca9c1-a8f7-41e5-8184-8aa644650ea1 req-a2d635e4-0c81-4368-954e-94fd2c8d7220 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bebb7ab7-cad1-4e94-aedd-5852d76b5f3c", "tag": "ccbac6d6-252a-4188-b391-a975bc7720c2"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:42:31.210221 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-c95ca9c1-a8f7-41e5-8184-8aa644650ea1 req-a2d635e4-0c81-4368-954e-94fd2c8d7220 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:31.211024 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-c95ca9c1-a8f7-41e5-8184-8aa644650ea1 req-a2d635e4-0c81-4368-954e-94fd2c8d7220 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:31.229279 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-c95ca9c1-a8f7-41e5-8184-8aa644650ea1 req-a2d635e4-0c81-4368-954e-94fd2c8d7220 service nova] Creating event network-changed:ccbac6d6-252a-4188-b391-a975bc7720c2 for instance bebb7ab7-cad1-4e94-aedd-5852d76b5f3c on hv-cinder-80382 Jun 24 09:42:31.238505 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-c95ca9c1-a8f7-41e5-8184-8aa644650ea1 req-a2d635e4-0c81-4368-954e-94fd2c8d7220 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158756 Jun 24 09:42:31.242998 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 33/59] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:42:31.405436 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-6a9c8191-c334-4b9d-9664-5903e15385b8 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:31.406062 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-6a9c8191-c334-4b9d-9664-5903e15385b8 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:31.413261 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6a9c8191-c334-4b9d-9664-5903e15385b8 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:31.413715 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6a9c8191-c334-4b9d-9664-5903e15385b8 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:31.416443 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6a9c8191-c334-4b9d-9664-5903e15385b8 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:31.428477 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6a9c8191-c334-4b9d-9664-5903e15385b8 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:31.469839 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-11f443c4-a3ce-4400-91b0-a1138886f07f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:31.470543 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-11f443c4-a3ce-4400-91b0-a1138886f07f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:31.473483 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=22 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:31.482636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-11f443c4-a3ce-4400-91b0-a1138886f07f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:31.483107 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-11f443c4-a3ce-4400-91b0-a1138886f07f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:31.483917 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-11f443c4-a3ce-4400-91b0-a1138886f07f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:31.484322 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-11f443c4-a3ce-4400-91b0-a1138886f07f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:31.643841 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6a9c8191-c334-4b9d-9664-5903e15385b8 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:31.657770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-6a9c8191-c334-4b9d-9664-5903e15385b8 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1314 microversion: 2.1 time: 0.256071 Jun 24 09:42:31.658724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 27/60] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:31 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:31.680126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f9743201-525d-42fd-ab66-ff1dbcb3917e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:31.680901 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-f9743201-525d-42fd-ab66-ff1dbcb3917e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:31.687792 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f9743201-525d-42fd-ab66-ff1dbcb3917e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:31.689351 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f9743201-525d-42fd-ab66-ff1dbcb3917e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:31.690420 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f9743201-525d-42fd-ab66-ff1dbcb3917e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:31.691005 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f9743201-525d-42fd-ab66-ff1dbcb3917e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:31.707753 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-11f443c4-a3ce-4400-91b0-a1138886f07f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:31.716442 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-11f443c4-a3ce-4400-91b0-a1138886f07f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1321 microversion: 2.1 time: 0.250705 Jun 24 09:42:31.717560 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 34/61] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:31 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:31.851795 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-f9743201-525d-42fd-ab66-ff1dbcb3917e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:31.861165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f9743201-525d-42fd-ab66-ff1dbcb3917e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1367 microversion: 2.1 time: 0.187097 Jun 24 09:42:31.862152 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-f21e9599-e578-4a04-a142-b2958e46c74b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:31.862932 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-f21e9599-e578-4a04-a142-b2958e46c74b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:31.869020 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f21e9599-e578-4a04-a142-b2958e46c74b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:31.869481 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f21e9599-e578-4a04-a142-b2958e46c74b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:31.870295 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f21e9599-e578-4a04-a142-b2958e46c74b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:31.870905 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f21e9599-e578-4a04-a142-b2958e46c74b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:31.871020 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 28/62] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:31 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:42:32.035640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f21e9599-e578-4a04-a142-b2958e46c74b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:32.066979 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f21e9599-e578-4a04-a142-b2958e46c74b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:32.066979 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f21e9599-e578-4a04-a142-b2958e46c74b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:32.066979 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-f21e9599-e578-4a04-a142-b2958e46c74b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1406 microversion: 2.20 time: 0.209058 Jun 24 09:42:32.067729 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 35/63] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:42:31 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:42:32.673956 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3cf1b15e-6a68-4b80-b0c8-ea114c4a9719 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:32.674562 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3cf1b15e-6a68-4b80-b0c8-ea114c4a9719 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:32.681714 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3cf1b15e-6a68-4b80-b0c8-ea114c4a9719 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:32.682510 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3cf1b15e-6a68-4b80-b0c8-ea114c4a9719 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:32.683545 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3cf1b15e-6a68-4b80-b0c8-ea114c4a9719 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:32.684192 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3cf1b15e-6a68-4b80-b0c8-ea114c4a9719 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:32.734397 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ac19863d-058a-41a0-a4bc-eeb4de996bfd tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:32.735178 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ac19863d-058a-41a0-a4bc-eeb4de996bfd tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:32.743983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ac19863d-058a-41a0-a4bc-eeb4de996bfd tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:32.744672 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ac19863d-058a-41a0-a4bc-eeb4de996bfd tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:32.745682 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ac19863d-058a-41a0-a4bc-eeb4de996bfd tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:32.746318 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ac19863d-058a-41a0-a4bc-eeb4de996bfd tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:32.837928 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=18 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:33.528431 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3cf1b15e-6a68-4b80-b0c8-ea114c4a9719 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:33.542192 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3cf1b15e-6a68-4b80-b0c8-ea114c4a9719 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1314 microversion: 2.1 time: 0.872154 Jun 24 09:42:33.544807 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 29/64] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:32 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1314 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:33.560185 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-caf650b8-1ba9-4f54-9717-b947443df2ba tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:33.563606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-caf650b8-1ba9-4f54-9717-b947443df2ba tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:33.581489 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-caf650b8-1ba9-4f54-9717-b947443df2ba tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:33.585038 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-caf650b8-1ba9-4f54-9717-b947443df2ba tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:33.589896 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-caf650b8-1ba9-4f54-9717-b947443df2ba tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:33.590648 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-caf650b8-1ba9-4f54-9717-b947443df2ba tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:33.768056 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ac19863d-058a-41a0-a4bc-eeb4de996bfd tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:33.790417 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ac19863d-058a-41a0-a4bc-eeb4de996bfd tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1321 microversion: 2.1 time: 1.055362 Jun 24 09:42:33.796058 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 36/65] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:32 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1321 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:33.811497 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-5c37b8f4-1995-4d66-b3c9-69f79aa5a1d7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:33.813622 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-5c37b8f4-1995-4d66-b3c9-69f79aa5a1d7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:33.834675 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5c37b8f4-1995-4d66-b3c9-69f79aa5a1d7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:33.835161 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5c37b8f4-1995-4d66-b3c9-69f79aa5a1d7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:33.836550 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5c37b8f4-1995-4d66-b3c9-69f79aa5a1d7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:33.837536 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5c37b8f4-1995-4d66-b3c9-69f79aa5a1d7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:34.224284 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-caf650b8-1ba9-4f54-9717-b947443df2ba tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:34.236198 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-caf650b8-1ba9-4f54-9717-b947443df2ba tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1367 microversion: 2.1 time: 0.688384 Jun 24 09:42:34.237275 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 30/66] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:33 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1367 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:34.255013 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-787ab510-2760-4982-b0df-12ca977e3848 req-5dc4c468-6a36-4fc4-8388-42aa9bd9117d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa551ac0-154e-4145-acc0-725155004e69", "tag": "371d87f0-d828-436b-a673-c5e34fc40e6c"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:42:34.264010 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-787ab510-2760-4982-b0df-12ca977e3848 req-5dc4c468-6a36-4fc4-8388-42aa9bd9117d service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:34.264666 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-787ab510-2760-4982-b0df-12ca977e3848 req-5dc4c468-6a36-4fc4-8388-42aa9bd9117d service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:34.277230 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-787ab510-2760-4982-b0df-12ca977e3848 req-5dc4c468-6a36-4fc4-8388-42aa9bd9117d service nova] Creating event network-changed:371d87f0-d828-436b-a673-c5e34fc40e6c for instance aa551ac0-154e-4145-acc0-725155004e69 on hv-cinder-80382 Jun 24 09:42:34.282787 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-787ab510-2760-4982-b0df-12ca977e3848 req-5dc4c468-6a36-4fc4-8388-42aa9bd9117d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032139 Jun 24 09:42:34.283435 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 31/67] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:42:34.290495 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-5c37b8f4-1995-4d66-b3c9-69f79aa5a1d7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:34.301071 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-5c37b8f4-1995-4d66-b3c9-69f79aa5a1d7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:34.302696 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-5c37b8f4-1995-4d66-b3c9-69f79aa5a1d7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:34.304440 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-5c37b8f4-1995-4d66-b3c9-69f79aa5a1d7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1406 microversion: 2.20 time: 0.507190 Jun 24 09:42:34.305558 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 37/68] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:42:33 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1406 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:42:34.441914 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-b6b1dc29-3b17-4ea2-8d18-f20ec02b8864 req-db27416d-40ad-4ed8-a8bb-300d6790b834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce878530-09af-4e67-9276-7b448c325d2f", "name": "network-vif-plugged", "status": "completed", "tag": "697f8edd-0704-4e42-8528-68705e30c6e2"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:42:34.453943 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-b6b1dc29-3b17-4ea2-8d18-f20ec02b8864 req-db27416d-40ad-4ed8-a8bb-300d6790b834 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:34.455123 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-b6b1dc29-3b17-4ea2-8d18-f20ec02b8864 req-db27416d-40ad-4ed8-a8bb-300d6790b834 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:34.471856 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-b6b1dc29-3b17-4ea2-8d18-f20ec02b8864 req-db27416d-40ad-4ed8-a8bb-300d6790b834 service nova] Creating event network-vif-plugged:697f8edd-0704-4e42-8528-68705e30c6e2 for instance ce878530-09af-4e67-9276-7b448c325d2f on hv-cinder-80382 Jun 24 09:42:34.484189 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-b6b1dc29-3b17-4ea2-8d18-f20ec02b8864 req-db27416d-40ad-4ed8-a8bb-300d6790b834 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195771 Jun 24 09:42:34.485316 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 32/69] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:42:34.569528 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7894238e-87a6-4a26-ae43-a8a86cd17f3b tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:34.570483 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-7894238e-87a6-4a26-ae43-a8a86cd17f3b tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:34.579648 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7894238e-87a6-4a26-ae43-a8a86cd17f3b tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:34.580725 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7894238e-87a6-4a26-ae43-a8a86cd17f3b tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:34.581991 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7894238e-87a6-4a26-ae43-a8a86cd17f3b tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:34.582595 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7894238e-87a6-4a26-ae43-a8a86cd17f3b tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:34.813678 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-8788f95b-9275-4696-8f31-88a485db1326 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:34.814634 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-8788f95b-9275-4696-8f31-88a485db1326 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:34.831342 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8788f95b-9275-4696-8f31-88a485db1326 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:34.832452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8788f95b-9275-4696-8f31-88a485db1326 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:34.851346 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8788f95b-9275-4696-8f31-88a485db1326 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:34.853289 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8788f95b-9275-4696-8f31-88a485db1326 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:35.011060 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-7894238e-87a6-4a26-ae43-a8a86cd17f3b tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:35.037100 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-7894238e-87a6-4a26-ae43-a8a86cd17f3b tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1314 microversion: 2.1 time: 0.477051 Jun 24 09:42:35.038386 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 38/70] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:34 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:35.043475 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-0445ca14-ddbf-4b26-be0d-91006ca07848 req-e385457d-78f6-4fce-8642-f8a57e5cf574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93a2b7d9-c03a-459b-9ceb-5d6bf14546ef", "tag": "cb40a2d0-f3d7-48fd-97c9-01e1ce70c8c1"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:42:35.072586 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-0445ca14-ddbf-4b26-be0d-91006ca07848 req-e385457d-78f6-4fce-8642-f8a57e5cf574 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:35.077033 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-0445ca14-ddbf-4b26-be0d-91006ca07848 req-e385457d-78f6-4fce-8642-f8a57e5cf574 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:35.098917 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-0445ca14-ddbf-4b26-be0d-91006ca07848 req-e385457d-78f6-4fce-8642-f8a57e5cf574 service nova] Creating event network-changed:cb40a2d0-f3d7-48fd-97c9-01e1ce70c8c1 for instance 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef on hv-cinder-80382 Jun 24 09:42:35.110110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-0445ca14-ddbf-4b26-be0d-91006ca07848 req-e385457d-78f6-4fce-8642-f8a57e5cf574 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070072 Jun 24 09:42:35.113070 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 39/71] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:42:35.181471 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-8788f95b-9275-4696-8f31-88a485db1326 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:35.205174 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-8788f95b-9275-4696-8f31-88a485db1326 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1321 microversion: 2.1 time: 0.394879 Jun 24 09:42:35.216911 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 33/72] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:34 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1321 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:35.257711 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-c2205734-a989-4a0a-b8e8-1436b5b5ef7d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:35.258805 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-c2205734-a989-4a0a-b8e8-1436b5b5ef7d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:35.272641 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c2205734-a989-4a0a-b8e8-1436b5b5ef7d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:35.275704 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c2205734-a989-4a0a-b8e8-1436b5b5ef7d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:35.278813 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c2205734-a989-4a0a-b8e8-1436b5b5ef7d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:35.280324 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c2205734-a989-4a0a-b8e8-1436b5b5ef7d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:35.321675 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=100 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:35.325963 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-74aa691b-65fa-49c4-9c10-da393de82587 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:35.327362 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-74aa691b-65fa-49c4-9c10-da393de82587 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:35.341302 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-74aa691b-65fa-49c4-9c10-da393de82587 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:35.342022 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-74aa691b-65fa-49c4-9c10-da393de82587 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:35.348115 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-74aa691b-65fa-49c4-9c10-da393de82587 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:35.350722 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-74aa691b-65fa-49c4-9c10-da393de82587 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:35.714618 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-c2205734-a989-4a0a-b8e8-1436b5b5ef7d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:35.726126 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-c2205734-a989-4a0a-b8e8-1436b5b5ef7d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1367 microversion: 2.1 time: 0.474503 Jun 24 09:42:35.727338 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 40/73] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:35 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1367 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:35.805462 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-74aa691b-65fa-49c4-9c10-da393de82587 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:35.814966 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-74aa691b-65fa-49c4-9c10-da393de82587 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:35.817409 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-74aa691b-65fa-49c4-9c10-da393de82587 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:35.818982 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-74aa691b-65fa-49c4-9c10-da393de82587 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1406 microversion: 2.20 time: 0.499148 Jun 24 09:42:35.830107 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 34/74] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:42:35 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1406 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:42:36.054312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-6721747a-361b-44b2-9bec-47c08f48e327 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:36.055044 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-6721747a-361b-44b2-9bec-47c08f48e327 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:36.062201 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6721747a-361b-44b2-9bec-47c08f48e327 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:36.062651 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6721747a-361b-44b2-9bec-47c08f48e327 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:36.064013 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6721747a-361b-44b2-9bec-47c08f48e327 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:36.064445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6721747a-361b-44b2-9bec-47c08f48e327 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:36.223703 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c534bc31-a9ed-4101-9878-e1b866a2abcf tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:36.224703 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-c534bc31-a9ed-4101-9878-e1b866a2abcf tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:36.241919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c534bc31-a9ed-4101-9878-e1b866a2abcf tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:36.242379 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c534bc31-a9ed-4101-9878-e1b866a2abcf tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:36.245623 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c534bc31-a9ed-4101-9878-e1b866a2abcf tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:36.248511 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c534bc31-a9ed-4101-9878-e1b866a2abcf tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:36.941354 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-6721747a-361b-44b2-9bec-47c08f48e327 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:36.963328 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-6721747a-361b-44b2-9bec-47c08f48e327 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1314 microversion: 2.1 time: 0.901551 Jun 24 09:42:36.963328 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 41/75] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:36 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1314 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:36.971692 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-a9667849-e80a-449b-98e1-8110101f2fa9 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:36.972610 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-a9667849-e80a-449b-98e1-8110101f2fa9 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:36.981994 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a9667849-e80a-449b-98e1-8110101f2fa9 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:36.982720 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a9667849-e80a-449b-98e1-8110101f2fa9 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:36.984690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a9667849-e80a-449b-98e1-8110101f2fa9 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:36.985670 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a9667849-e80a-449b-98e1-8110101f2fa9 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:37.097928 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c534bc31-a9ed-4101-9878-e1b866a2abcf tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:37.109773 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-c534bc31-a9ed-4101-9878-e1b866a2abcf tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1321 microversion: 2.1 time: 0.890208 Jun 24 09:42:37.121667 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 35/76] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:36 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1321 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:37.127257 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7095648d-c4cd-4a85-959d-dafbf1ba749a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:37.128172 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-7095648d-c4cd-4a85-959d-dafbf1ba749a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:37.135130 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7095648d-c4cd-4a85-959d-dafbf1ba749a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:37.135866 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7095648d-c4cd-4a85-959d-dafbf1ba749a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:37.136875 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7095648d-c4cd-4a85-959d-dafbf1ba749a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:37.137590 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7095648d-c4cd-4a85-959d-dafbf1ba749a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:37.570389 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-a9667849-e80a-449b-98e1-8110101f2fa9 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:37.572745 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=6 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:37.592930 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-a9667849-e80a-449b-98e1-8110101f2fa9 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1367 microversion: 2.1 time: 0.634091 Jun 24 09:42:37.593539 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 42/77] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:36 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1367 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:37.598376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-0904d869-8024-4acf-87f8-1c13287e6b5a req-460ea263-ffc9-4c8c-aa1b-12eff07118ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bebb7ab7-cad1-4e94-aedd-5852d76b5f3c", "name": "network-vif-plugged", "status": "completed", "tag": "ccbac6d6-252a-4188-b391-a975bc7720c2"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:42:37.620550 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-0904d869-8024-4acf-87f8-1c13287e6b5a req-460ea263-ffc9-4c8c-aa1b-12eff07118ee service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:37.620972 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-0904d869-8024-4acf-87f8-1c13287e6b5a req-460ea263-ffc9-4c8c-aa1b-12eff07118ee service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:37.642825 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-0904d869-8024-4acf-87f8-1c13287e6b5a req-460ea263-ffc9-4c8c-aa1b-12eff07118ee service nova] Creating event network-vif-plugged:ccbac6d6-252a-4188-b391-a975bc7720c2 for instance bebb7ab7-cad1-4e94-aedd-5852d76b5f3c on hv-cinder-80382 Jun 24 09:42:37.656919 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-0904d869-8024-4acf-87f8-1c13287e6b5a req-460ea263-ffc9-4c8c-aa1b-12eff07118ee service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062120 Jun 24 09:42:37.657841 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 43/78] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:42:37.796229 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-7095648d-c4cd-4a85-959d-dafbf1ba749a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:37.808840 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-7095648d-c4cd-4a85-959d-dafbf1ba749a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:37.813720 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-7095648d-c4cd-4a85-959d-dafbf1ba749a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:37.815159 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-7095648d-c4cd-4a85-959d-dafbf1ba749a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1406 microversion: 2.20 time: 0.692020 Jun 24 09:42:37.815758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 36/79] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:42:37 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1406 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:42:37.976811 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-6964303a-29ec-4219-a4da-6214b2fb85d8 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:37.984048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-6964303a-29ec-4219-a4da-6214b2fb85d8 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:37.993389 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6964303a-29ec-4219-a4da-6214b2fb85d8 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:37.993963 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6964303a-29ec-4219-a4da-6214b2fb85d8 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:37.994754 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6964303a-29ec-4219-a4da-6214b2fb85d8 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:37.995221 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6964303a-29ec-4219-a4da-6214b2fb85d8 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:38.128238 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-40e0f6fe-26f7-4e41-a09d-1993bc6a3861 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:38.129427 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-40e0f6fe-26f7-4e41-a09d-1993bc6a3861 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:38.140779 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-40e0f6fe-26f7-4e41-a09d-1993bc6a3861 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:38.142776 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-40e0f6fe-26f7-4e41-a09d-1993bc6a3861 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:38.146320 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-40e0f6fe-26f7-4e41-a09d-1993bc6a3861 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:38.147251 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-40e0f6fe-26f7-4e41-a09d-1993bc6a3861 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:38.440836 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-6964303a-29ec-4219-a4da-6214b2fb85d8 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:38.461128 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-6964303a-29ec-4219-a4da-6214b2fb85d8 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1314 microversion: 2.1 time: 0.487446 Jun 24 09:42:38.463269 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 44/80] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:37 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:38.488554 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-40e0f6fe-26f7-4e41-a09d-1993bc6a3861 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:38.501892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-40e0f6fe-26f7-4e41-a09d-1993bc6a3861 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1321 microversion: 2.1 time: 0.377562 Jun 24 09:42:38.503118 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 37/81] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:38 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:42:38.610848 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-457c1903-226b-49e4-9b68-dc2a5f42aeff tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:38.612641 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-457c1903-226b-49e4-9b68-dc2a5f42aeff tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:38.623948 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-457c1903-226b-49e4-9b68-dc2a5f42aeff tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:38.636745 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-457c1903-226b-49e4-9b68-dc2a5f42aeff tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:38.639305 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-457c1903-226b-49e4-9b68-dc2a5f42aeff tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:38.643813 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-457c1903-226b-49e4-9b68-dc2a5f42aeff tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:38.836057 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-50731ada-7bdb-416e-8903-12ff166a1276 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:38.838709 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-50731ada-7bdb-416e-8903-12ff166a1276 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:38.852050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-50731ada-7bdb-416e-8903-12ff166a1276 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:38.854819 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-50731ada-7bdb-416e-8903-12ff166a1276 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:38.858830 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-50731ada-7bdb-416e-8903-12ff166a1276 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:38.860779 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-50731ada-7bdb-416e-8903-12ff166a1276 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:38.876939 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-457c1903-226b-49e4-9b68-dc2a5f42aeff tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:38.885728 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-457c1903-226b-49e4-9b68-dc2a5f42aeff tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1367 microversion: 2.1 time: 0.279656 Jun 24 09:42:38.889678 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 45/82] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:38 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:39.389464 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-50731ada-7bdb-416e-8903-12ff166a1276 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:39.405670 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-50731ada-7bdb-416e-8903-12ff166a1276 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:39.415473 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-50731ada-7bdb-416e-8903-12ff166a1276 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:39.416942 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-50731ada-7bdb-416e-8903-12ff166a1276 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1406 microversion: 2.20 time: 0.587202 Jun 24 09:42:39.417683 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 38/83] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:42:38 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1406 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:42:39.480141 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-8e5618e5-e101-4f6d-97b3-5f5778642eb9 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:39.480890 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-8e5618e5-e101-4f6d-97b3-5f5778642eb9 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:39.511757 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8e5618e5-e101-4f6d-97b3-5f5778642eb9 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:39.511965 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8e5618e5-e101-4f6d-97b3-5f5778642eb9 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:39.513369 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8e5618e5-e101-4f6d-97b3-5f5778642eb9 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:39.513828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8e5618e5-e101-4f6d-97b3-5f5778642eb9 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:39.527382 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-70ec2894-14e1-493f-822d-22799f29cc21 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:39.528583 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-70ec2894-14e1-493f-822d-22799f29cc21 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:39.539748 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-70ec2894-14e1-493f-822d-22799f29cc21 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:39.540233 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-70ec2894-14e1-493f-822d-22799f29cc21 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:39.541949 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-70ec2894-14e1-493f-822d-22799f29cc21 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:39.542398 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-70ec2894-14e1-493f-822d-22799f29cc21 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:39.872267 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-70ec2894-14e1-493f-822d-22799f29cc21 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:39.879640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-8e5618e5-e101-4f6d-97b3-5f5778642eb9 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:39.880786 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-70ec2894-14e1-493f-822d-22799f29cc21 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1321 microversion: 2.1 time: 0.361369 Jun 24 09:42:39.881381 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 39/84] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:39 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1321 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:39.896076 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-8e5618e5-e101-4f6d-97b3-5f5778642eb9 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1314 microversion: 2.1 time: 0.419457 Jun 24 09:42:39.897294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 46/85] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:39 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:39.906167 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7981b3b3-2437-4017-8334-012ffaa8edb0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:39.906779 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-7981b3b3-2437-4017-8334-012ffaa8edb0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:39.915933 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7981b3b3-2437-4017-8334-012ffaa8edb0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:39.917215 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7981b3b3-2437-4017-8334-012ffaa8edb0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:39.918496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7981b3b3-2437-4017-8334-012ffaa8edb0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:39.919212 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7981b3b3-2437-4017-8334-012ffaa8edb0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:40.110478 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-7981b3b3-2437-4017-8334-012ffaa8edb0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:40.120188 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-7981b3b3-2437-4017-8334-012ffaa8edb0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1367 microversion: 2.1 time: 0.217730 Jun 24 09:42:40.121098 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 40/86] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:39 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:40.435738 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-5206ecfd-4ad5-486f-b634-8ecc026361b1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:40.436616 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-5206ecfd-4ad5-486f-b634-8ecc026361b1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:40.438612 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:40.444130 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5206ecfd-4ad5-486f-b634-8ecc026361b1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:40.444584 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5206ecfd-4ad5-486f-b634-8ecc026361b1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:40.445359 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5206ecfd-4ad5-486f-b634-8ecc026361b1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:40.445846 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5206ecfd-4ad5-486f-b634-8ecc026361b1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:40.597188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-5206ecfd-4ad5-486f-b634-8ecc026361b1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:40.605535 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-5206ecfd-4ad5-486f-b634-8ecc026361b1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:40.607735 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-5206ecfd-4ad5-486f-b634-8ecc026361b1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:40.608744 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-5206ecfd-4ad5-486f-b634-8ecc026361b1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1406 microversion: 2.20 time: 0.177375 Jun 24 09:42:40.609255 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 47/87] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:42:40 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:42:40.897324 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7be61bd0-aba7-4ac7-b984-de71adcbbfb8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:40.898905 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-7be61bd0-aba7-4ac7-b984-de71adcbbfb8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:40.905287 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7be61bd0-aba7-4ac7-b984-de71adcbbfb8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:40.905746 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7be61bd0-aba7-4ac7-b984-de71adcbbfb8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:40.906529 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7be61bd0-aba7-4ac7-b984-de71adcbbfb8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:40.906970 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7be61bd0-aba7-4ac7-b984-de71adcbbfb8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:40.913404 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-32c2c4d5-b578-45f8-ae78-aa198ee33603 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:40.914964 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-32c2c4d5-b578-45f8-ae78-aa198ee33603 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:40.923321 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-32c2c4d5-b578-45f8-ae78-aa198ee33603 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:40.924021 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-32c2c4d5-b578-45f8-ae78-aa198ee33603 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:40.924807 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-32c2c4d5-b578-45f8-ae78-aa198ee33603 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:40.925284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-32c2c4d5-b578-45f8-ae78-aa198ee33603 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:41.141225 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-7be61bd0-aba7-4ac7-b984-de71adcbbfb8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:41.148914 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-32c2c4d5-b578-45f8-ae78-aa198ee33603 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:41.153266 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-7be61bd0-aba7-4ac7-b984-de71adcbbfb8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1321 microversion: 2.1 time: 0.260132 Jun 24 09:42:41.153870 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 41/88] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:40 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:41.158399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-32c2c4d5-b578-45f8-ae78-aa198ee33603 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1502 microversion: 2.1 time: 0.248681 Jun 24 09:42:41.167368 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 48/89] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:40 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1502 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:42:41.174496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a12b4b40-86a5-4f4f-887e-3cbd0f3b7f37 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:41.175189 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-a12b4b40-86a5-4f4f-887e-3cbd0f3b7f37 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:41.182052 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a12b4b40-86a5-4f4f-887e-3cbd0f3b7f37 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:41.182624 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a12b4b40-86a5-4f4f-887e-3cbd0f3b7f37 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:41.184020 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a12b4b40-86a5-4f4f-887e-3cbd0f3b7f37 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:41.184467 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a12b4b40-86a5-4f4f-887e-3cbd0f3b7f37 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:41.350522 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-a12b4b40-86a5-4f4f-887e-3cbd0f3b7f37 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:41.363271 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-a12b4b40-86a5-4f4f-887e-3cbd0f3b7f37 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1367 microversion: 2.1 time: 0.196344 Jun 24 09:42:41.363985 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 42/90] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:41 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:41.629112 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-d99c2d9a-f935-4f5e-9f25-30a136a0e2ef tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:41.629882 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-d99c2d9a-f935-4f5e-9f25-30a136a0e2ef tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:41.637210 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d99c2d9a-f935-4f5e-9f25-30a136a0e2ef tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:41.637961 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d99c2d9a-f935-4f5e-9f25-30a136a0e2ef tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:41.638937 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d99c2d9a-f935-4f5e-9f25-30a136a0e2ef tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:41.639615 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d99c2d9a-f935-4f5e-9f25-30a136a0e2ef tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:41.776496 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d99c2d9a-f935-4f5e-9f25-30a136a0e2ef tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:41.784777 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d99c2d9a-f935-4f5e-9f25-30a136a0e2ef tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:41.786122 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d99c2d9a-f935-4f5e-9f25-30a136a0e2ef tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:41.787336 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-d99c2d9a-f935-4f5e-9f25-30a136a0e2ef tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1406 microversion: 2.20 time: 0.164320 Jun 24 09:42:41.788058 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 49/91] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:42:41 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:42:42.172990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-fc3133ba-02ef-4d9e-84ab-c8777cb09b51 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:42.174688 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-fc3133ba-02ef-4d9e-84ab-c8777cb09b51 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:42.201246 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fc3133ba-02ef-4d9e-84ab-c8777cb09b51 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:42.205604 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fc3133ba-02ef-4d9e-84ab-c8777cb09b51 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:42.206660 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fc3133ba-02ef-4d9e-84ab-c8777cb09b51 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:42.207186 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fc3133ba-02ef-4d9e-84ab-c8777cb09b51 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:42.211995 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=100 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:42.381919 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-9f2f21d7-b4ec-4258-9d4a-ce88cf4e1788 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:42.383756 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-9f2f21d7-b4ec-4258-9d4a-ce88cf4e1788 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:42.396430 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9f2f21d7-b4ec-4258-9d4a-ce88cf4e1788 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:42.397226 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9f2f21d7-b4ec-4258-9d4a-ce88cf4e1788 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:42.398985 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9f2f21d7-b4ec-4258-9d4a-ce88cf4e1788 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:42.400473 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9f2f21d7-b4ec-4258-9d4a-ce88cf4e1788 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:42.410923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-fc3133ba-02ef-4d9e-84ab-c8777cb09b51 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:42.419380 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-fc3133ba-02ef-4d9e-84ab-c8777cb09b51 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1321 microversion: 2.1 time: 0.252480 Jun 24 09:42:42.421026 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 43/92] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:42 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:42.643925 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-56a138b5-6830-4158-8a25-6350336bac22 req-e5d17415-b50b-45a5-916c-0339f146a5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa551ac0-154e-4145-acc0-725155004e69", "name": "network-vif-plugged", "status": "completed", "tag": "371d87f0-d828-436b-a673-c5e34fc40e6c"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:42:42.659351 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-56a138b5-6830-4158-8a25-6350336bac22 req-e5d17415-b50b-45a5-916c-0339f146a5a4 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:42.659797 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-56a138b5-6830-4158-8a25-6350336bac22 req-e5d17415-b50b-45a5-916c-0339f146a5a4 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:42.690527 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-56a138b5-6830-4158-8a25-6350336bac22 req-e5d17415-b50b-45a5-916c-0339f146a5a4 service nova] Creating event network-vif-plugged:371d87f0-d828-436b-a673-c5e34fc40e6c for instance aa551ac0-154e-4145-acc0-725155004e69 on hv-cinder-80382 Jun 24 09:42:42.703343 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-9f2f21d7-b4ec-4258-9d4a-ce88cf4e1788 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:42.705594 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-56a138b5-6830-4158-8a25-6350336bac22 req-e5d17415-b50b-45a5-916c-0339f146a5a4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066081 Jun 24 09:42:42.722296 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 44/93] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:42:42.724428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-9f2f21d7-b4ec-4258-9d4a-ce88cf4e1788 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1367 microversion: 2.1 time: 0.347500 Jun 24 09:42:42.730416 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 50/94] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:42 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:42.807947 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4415d8d4-94d1-4856-9bd4-b45d38ba056f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:42.808615 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-4415d8d4-94d1-4856-9bd4-b45d38ba056f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:42.821811 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4415d8d4-94d1-4856-9bd4-b45d38ba056f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:42.823102 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4415d8d4-94d1-4856-9bd4-b45d38ba056f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:42.835872 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4415d8d4-94d1-4856-9bd4-b45d38ba056f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:42.837810 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4415d8d4-94d1-4856-9bd4-b45d38ba056f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:42.854169 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-1bef5e7b-c567-48c2-9661-e143d461333c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d7ecf68-e5f6-4eca-b39a-416cfe6f326a"}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:42:42.855926 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-1bef5e7b-c567-48c2-9661-e143d461333c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:42.873388 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1bef5e7b-c567-48c2-9661-e143d461333c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:42.874088 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1bef5e7b-c567-48c2-9661-e143d461333c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:42.878915 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1bef5e7b-c567-48c2-9661-e143d461333c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:42.879679 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1bef5e7b-c567-48c2-9661-e143d461333c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:43.176802 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4415d8d4-94d1-4856-9bd4-b45d38ba056f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:43.191166 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4415d8d4-94d1-4856-9bd4-b45d38ba056f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:43.192704 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4415d8d4-94d1-4856-9bd4-b45d38ba056f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:43.193837 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-4415d8d4-94d1-4856-9bd4-b45d38ba056f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1406 microversion: 2.20 time: 0.391984 Jun 24 09:42:43.194393 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 45/95] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:42:42 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1406 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:42:43.440123 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e1a2cf2f-9560-4dca-9c47-958aae686d73 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:43.441370 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e1a2cf2f-9560-4dca-9c47-958aae686d73 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:43.452703 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e1a2cf2f-9560-4dca-9c47-958aae686d73 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:43.453417 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e1a2cf2f-9560-4dca-9c47-958aae686d73 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:43.454786 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e1a2cf2f-9560-4dca-9c47-958aae686d73 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:43.455717 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e1a2cf2f-9560-4dca-9c47-958aae686d73 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:43.669121 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e1a2cf2f-9560-4dca-9c47-958aae686d73 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:43.679355 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e1a2cf2f-9560-4dca-9c47-958aae686d73 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1515 microversion: 2.1 time: 0.246981 Jun 24 09:42:43.680470 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 46/96] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:43 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1515 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:42:43.696610 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4d945ded-01b4-4a84-8959-3529a78f5004 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:42:43.697818 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-4d945ded-01b4-4a84-8959-3529a78f5004 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:43.705047 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4d945ded-01b4-4a84-8959-3529a78f5004 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:43.705737 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4d945ded-01b4-4a84-8959-3529a78f5004 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:43.706524 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4d945ded-01b4-4a84-8959-3529a78f5004 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:43.706957 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4d945ded-01b4-4a84-8959-3529a78f5004 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:43.786663 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.objects.instance [None req-4d945ded-01b4-4a84-8959-3529a78f5004 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lazy-loading 'flavor' on Instance uuid bebb7ab7-cad1-4e94-aedd-5852d76b5f3c {{(pid=124339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:42:43.923882 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-4d945ded-01b4-4a84-8959-3529a78f5004 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "POST /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c/action" status: 200 len: 32 microversion: 2.1 time: 0.230756 Jun 24 09:42:43.924805 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 47/97] 10.222.0.65 () {60 vars in 1277 bytes} [Fri Jun 24 09:42:43 2022] POST /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c/action => generated 32 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 24 09:42:43.930507 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e021ecea-72d4-49bb-929d-71cf6417ea46 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:43.931365 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e021ecea-72d4-49bb-929d-71cf6417ea46 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:43.938637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e021ecea-72d4-49bb-929d-71cf6417ea46 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:43.939142 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e021ecea-72d4-49bb-929d-71cf6417ea46 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:43.939937 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e021ecea-72d4-49bb-929d-71cf6417ea46 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:43.940378 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e021ecea-72d4-49bb-929d-71cf6417ea46 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:44.103486 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e021ecea-72d4-49bb-929d-71cf6417ea46 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:44.111405 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e021ecea-72d4-49bb-929d-71cf6417ea46 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1367 microversion: 2.1 time: 0.185279 Jun 24 09:42:44.112299 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 48/98] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:43 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:44.116895 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-197b9528-80c1-43a5-b7d3-2c63f3eb1cc1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:44.118156 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-197b9528-80c1-43a5-b7d3-2c63f3eb1cc1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:44.125274 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-197b9528-80c1-43a5-b7d3-2c63f3eb1cc1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:44.125945 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-197b9528-80c1-43a5-b7d3-2c63f3eb1cc1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:44.126933 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-197b9528-80c1-43a5-b7d3-2c63f3eb1cc1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:44.127817 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-197b9528-80c1-43a5-b7d3-2c63f3eb1cc1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:44.374052 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-197b9528-80c1-43a5-b7d3-2c63f3eb1cc1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:44.381761 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-197b9528-80c1-43a5-b7d3-2c63f3eb1cc1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1521 microversion: 2.1 time: 0.268450 Jun 24 09:42:44.382396 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 49/99] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:44 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:44.396121 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-36013393-e3cb-4b14-81ab-e4773e267d0b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:44.396734 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-36013393-e3cb-4b14-81ab-e4773e267d0b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:44.403010 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-36013393-e3cb-4b14-81ab-e4773e267d0b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:44.403486 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-36013393-e3cb-4b14-81ab-e4773e267d0b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:44.404252 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-36013393-e3cb-4b14-81ab-e4773e267d0b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:44.404687 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-36013393-e3cb-4b14-81ab-e4773e267d0b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:44.615725 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-36013393-e3cb-4b14-81ab-e4773e267d0b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:44.625645 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-36013393-e3cb-4b14-81ab-e4773e267d0b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:44.627160 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-36013393-e3cb-4b14-81ab-e4773e267d0b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:44.628292 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-36013393-e3cb-4b14-81ab-e4773e267d0b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1406 microversion: 2.20 time: 0.235967 Jun 24 09:42:44.628843 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 50/100] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:42:44 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:42:44.784359 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-32b99cf8-70af-4d45-b493-73f8c256ed27 req-537af02a-d1a5-4324-9589-e08f7e9e6118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2135f6c7-0718-46fa-94a8-f948e487e37f", "name": "network-vif-plugged", "status": "completed", "tag": "70b66b36-bc61-4e7d-8b33-ed840e49fe68"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:42:44.798351 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-32b99cf8-70af-4d45-b493-73f8c256ed27 req-537af02a-d1a5-4324-9589-e08f7e9e6118 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:44.799579 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-32b99cf8-70af-4d45-b493-73f8c256ed27 req-537af02a-d1a5-4324-9589-e08f7e9e6118 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:44.818520 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-32b99cf8-70af-4d45-b493-73f8c256ed27 req-537af02a-d1a5-4324-9589-e08f7e9e6118 service nova] Creating event network-vif-plugged:70b66b36-bc61-4e7d-8b33-ed840e49fe68 for instance 2135f6c7-0718-46fa-94a8-f948e487e37f on hv-cinder-80382 Jun 24 09:42:44.824084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-32b99cf8-70af-4d45-b493-73f8c256ed27 req-537af02a-d1a5-4324-9589-e08f7e9e6118 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043866 Jun 24 09:42:44.824690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 51/101] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:42:45.128367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-98834820-ac06-42bd-aa7d-c1ab694cd0ed tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:45.129324 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-98834820-ac06-42bd-aa7d-c1ab694cd0ed tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:45.135958 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-98834820-ac06-42bd-aa7d-c1ab694cd0ed tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:45.136452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-98834820-ac06-42bd-aa7d-c1ab694cd0ed tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:45.137440 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-98834820-ac06-42bd-aa7d-c1ab694cd0ed tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:45.138506 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-98834820-ac06-42bd-aa7d-c1ab694cd0ed tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:45.288246 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-98834820-ac06-42bd-aa7d-c1ab694cd0ed tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:45.296847 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-98834820-ac06-42bd-aa7d-c1ab694cd0ed tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1367 microversion: 2.1 time: 0.172611 Jun 24 09:42:45.297436 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 52/102] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:45 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:42:45.401617 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e7656c0c-b4e4-4df3-80dc-5e6138dc73b8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:45.402329 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e7656c0c-b4e4-4df3-80dc-5e6138dc73b8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:45.404627 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:45.411747 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e7656c0c-b4e4-4df3-80dc-5e6138dc73b8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:45.412273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e7656c0c-b4e4-4df3-80dc-5e6138dc73b8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:45.413181 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e7656c0c-b4e4-4df3-80dc-5e6138dc73b8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:45.413695 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e7656c0c-b4e4-4df3-80dc-5e6138dc73b8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:45.560257 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e7656c0c-b4e4-4df3-80dc-5e6138dc73b8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:45.573069 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e7656c0c-b4e4-4df3-80dc-5e6138dc73b8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1521 microversion: 2.1 time: 0.176419 Jun 24 09:42:45.573855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 53/103] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:45 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:45.651134 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-90110c08-9e07-462f-a5c3-324895a9c28a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:45.652262 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-90110c08-9e07-462f-a5c3-324895a9c28a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:45.663821 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-90110c08-9e07-462f-a5c3-324895a9c28a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:45.665321 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-90110c08-9e07-462f-a5c3-324895a9c28a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:45.666357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-90110c08-9e07-462f-a5c3-324895a9c28a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:45.666799 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-90110c08-9e07-462f-a5c3-324895a9c28a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:45.815471 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-90110c08-9e07-462f-a5c3-324895a9c28a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:45.823777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-90110c08-9e07-462f-a5c3-324895a9c28a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:45.825296 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-90110c08-9e07-462f-a5c3-324895a9c28a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:45.826411 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-90110c08-9e07-462f-a5c3-324895a9c28a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1406 microversion: 2.20 time: 0.181705 Jun 24 09:42:45.826986 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 54/104] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:42:45 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:42:46.251467 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3fb69934-233b-44b9-9c4e-1ad73ebf8aac tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-487183018", "imageRef": "844ad823-18a2-4abc-813c-2d1825141591", "flavorRef": "452", "networks": [{"uuid": "011dd503-a916-4a1e-aafe-2bca320c6dcb"}]}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:42:46.304574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.network.neutron [None req-3fb69934-233b-44b9-9c4e-1ad73ebf8aac tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] validate_networks() for [('011dd503-a916-4a1e-aafe-2bca320c6dcb', None, None, None, None, None)] {{(pid=124339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:42:46.785123 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-1bef5e7b-c567-48c2-9661-e143d461333c tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "POST /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.935344 Jun 24 09:42:46.786386 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 51/105] 10.222.0.65 () {60 vars in 1322 bytes} [Fri Jun 24 09:42:42 2022] POST /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f/os-volume_attachments => generated 194 bytes in 3938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:42:46.811101 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-0312021a-0b30-4554-9953-c9005f1757f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:46.815215 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-0312021a-0b30-4554-9953-c9005f1757f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:46.822567 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0312021a-0b30-4554-9953-c9005f1757f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:46.823206 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0312021a-0b30-4554-9953-c9005f1757f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:46.824197 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0312021a-0b30-4554-9953-c9005f1757f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:46.824737 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0312021a-0b30-4554-9953-c9005f1757f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:47.024820 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-3fb69934-233b-44b9-9c4e-1ad73ebf8aac tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Flavor limits 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:42:47.025335 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-3fb69934-233b-44b9-9c4e-1ad73ebf8aac tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Image limits 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:42:47.025887 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-3fb69934-233b-44b9-9c4e-1ad73ebf8aac tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Flavor pref 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:42:47.026471 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-3fb69934-233b-44b9-9c4e-1ad73ebf8aac tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Image pref 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:42:47.027322 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-3fb69934-233b-44b9-9c4e-1ad73ebf8aac tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:42:47.041072 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3fb69934-233b-44b9-9c4e-1ad73ebf8aac tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:47.041840 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3fb69934-233b-44b9-9c4e-1ad73ebf8aac tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:47.043756 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3fb69934-233b-44b9-9c4e-1ad73ebf8aac tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:47.044264 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3fb69934-233b-44b9-9c4e-1ad73ebf8aac tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:47.072671 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-0312021a-0b30-4554-9953-c9005f1757f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:47.075580 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-3fb69934-233b-44b9-9c4e-1ad73ebf8aac tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Getting quotas for project 6c5b285a04564d5d917a4566bec984b2. Resources: {'cores', 'ram', 'instances'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:42:47.080079 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-3fb69934-233b-44b9-9c4e-1ad73ebf8aac tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Getting quotas for user 1e4d2ec6d0014c99a818e1000869b38c and project 6c5b285a04564d5d917a4566bec984b2. Resources: {'cores', 'ram', 'instances'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:42:47.081160 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-0312021a-0b30-4554-9953-c9005f1757f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1367 microversion: 2.1 time: 0.293213 Jun 24 09:42:47.081957 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 52/106] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:46 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:47.088354 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-8e3008c4-9b39-474c-8074-602a64e6b02c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:47.089201 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-8e3008c4-9b39-474c-8074-602a64e6b02c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:47.095382 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8e3008c4-9b39-474c-8074-602a64e6b02c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:47.096070 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8e3008c4-9b39-474c-8074-602a64e6b02c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:47.097037 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8e3008c4-9b39-474c-8074-602a64e6b02c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:47.097535 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8e3008c4-9b39-474c-8074-602a64e6b02c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:47.101355 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3fb69934-233b-44b9-9c4e-1ad73ebf8aac tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Going to run 1 instances... {{(pid=124339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:42:47.104051 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3fb69934-233b-44b9-9c4e-1ad73ebf8aac tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='844ad823-18a2-4abc-813c-2d1825141591',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:42:47.164695 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3fb69934-233b-44b9-9c4e-1ad73ebf8aac tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.917075 Jun 24 09:42:47.170624 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 55/107] 10.222.0.65 () {60 vars in 1146 bytes} [Fri Jun 24 09:42:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 09:42:47.172450 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-2afb0d10-c3f7-476e-8b7d-8ac84cc3bd78 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:47.173073 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-2afb0d10-c3f7-476e-8b7d-8ac84cc3bd78 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:47.180878 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2afb0d10-c3f7-476e-8b7d-8ac84cc3bd78 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:47.181331 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2afb0d10-c3f7-476e-8b7d-8ac84cc3bd78 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:47.182159 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2afb0d10-c3f7-476e-8b7d-8ac84cc3bd78 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:47.182595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2afb0d10-c3f7-476e-8b7d-8ac84cc3bd78 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:47.307568 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-8e3008c4-9b39-474c-8074-602a64e6b02c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:47.316784 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-8e3008c4-9b39-474c-8074-602a64e6b02c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1521 microversion: 2.1 time: 0.231919 Jun 24 09:42:47.317477 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 53/108] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:47 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:47.322527 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-979d7a9e-15a9-459f-9d99-900b287fa91a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:47.323352 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-979d7a9e-15a9-459f-9d99-900b287fa91a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:47.396689 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-979d7a9e-15a9-459f-9d99-900b287fa91a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:47.406089 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-979d7a9e-15a9-459f-9d99-900b287fa91a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 200 len: 1213 microversion: 2.1 time: 0.087412 Jun 24 09:42:47.407175 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 54/109] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:47 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:47.428492 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-2afb0d10-c3f7-476e-8b7d-8ac84cc3bd78 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:47.439664 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-2afb0d10-c3f7-476e-8b7d-8ac84cc3bd78 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:47.442235 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-2afb0d10-c3f7-476e-8b7d-8ac84cc3bd78 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:47.444196 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-2afb0d10-c3f7-476e-8b7d-8ac84cc3bd78 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1406 microversion: 2.20 time: 0.277140 Jun 24 09:42:47.456539 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 56/110] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:42:47 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1406 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:42:48.100694 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-5d2e7de1-e337-4e1f-938d-399b2fe5399b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:48.101892 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-5d2e7de1-e337-4e1f-938d-399b2fe5399b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:48.110647 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5d2e7de1-e337-4e1f-938d-399b2fe5399b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:48.111083 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5d2e7de1-e337-4e1f-938d-399b2fe5399b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:48.111898 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5d2e7de1-e337-4e1f-938d-399b2fe5399b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:48.112342 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5d2e7de1-e337-4e1f-938d-399b2fe5399b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:48.295281 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-5d2e7de1-e337-4e1f-938d-399b2fe5399b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:48.303324 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-5d2e7de1-e337-4e1f-938d-399b2fe5399b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1367 microversion: 2.1 time: 0.209125 Jun 24 09:42:48.303891 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 55/111] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:48 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:48.333727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-26ee68fa-d007-4f16-9803-b6591fb43295 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:48.334435 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-26ee68fa-d007-4f16-9803-b6591fb43295 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:48.340810 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-26ee68fa-d007-4f16-9803-b6591fb43295 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:48.341356 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-26ee68fa-d007-4f16-9803-b6591fb43295 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:48.342194 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-26ee68fa-d007-4f16-9803-b6591fb43295 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:48.342715 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-26ee68fa-d007-4f16-9803-b6591fb43295 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:48.427352 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-a78ae3cd-6bac-4f31-9bf7-543b0227c6d3 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:48.427739 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-a78ae3cd-6bac-4f31-9bf7-543b0227c6d3 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:48.437858 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a78ae3cd-6bac-4f31-9bf7-543b0227c6d3 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:48.438566 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a78ae3cd-6bac-4f31-9bf7-543b0227c6d3 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:48.439596 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a78ae3cd-6bac-4f31-9bf7-543b0227c6d3 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:48.440257 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a78ae3cd-6bac-4f31-9bf7-543b0227c6d3 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:48.726582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-26ee68fa-d007-4f16-9803-b6591fb43295 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:48.737041 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-26ee68fa-d007-4f16-9803-b6591fb43295 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1521 microversion: 2.1 time: 0.407238 Jun 24 09:42:48.738866 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 57/112] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:48 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:48.746722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-a78ae3cd-6bac-4f31-9bf7-543b0227c6d3 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:48.758468 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-8d55d393-b580-45e5-b999-de43e9cb5cb9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:48.759295 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-8d55d393-b580-45e5-b999-de43e9cb5cb9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:48.766422 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8d55d393-b580-45e5-b999-de43e9cb5cb9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:48.767112 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-a78ae3cd-6bac-4f31-9bf7-543b0227c6d3 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 200 len: 1209 microversion: 2.1 time: 0.342843 Jun 24 09:42:48.767544 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8d55d393-b580-45e5-b999-de43e9cb5cb9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:48.768520 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8d55d393-b580-45e5-b999-de43e9cb5cb9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:48.769149 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8d55d393-b580-45e5-b999-de43e9cb5cb9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:48.779302 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 56/113] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:48 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 1209 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:48.959696 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-8d55d393-b580-45e5-b999-de43e9cb5cb9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:48.972784 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-8d55d393-b580-45e5-b999-de43e9cb5cb9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:48.974648 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-8d55d393-b580-45e5-b999-de43e9cb5cb9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:48.976152 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-8d55d393-b580-45e5-b999-de43e9cb5cb9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1598 microversion: 2.20 time: 0.235302 Jun 24 09:42:48.977442 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 58/114] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:42:48 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1598 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:42:49.006736 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-e18da1ea-b2c8-42d7-90d5-c4a96c911c44 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:49.008355 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-e18da1ea-b2c8-42d7-90d5-c4a96c911c44 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:49.030404 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e18da1ea-b2c8-42d7-90d5-c4a96c911c44 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:49.030890 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e18da1ea-b2c8-42d7-90d5-c4a96c911c44 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:49.031728 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e18da1ea-b2c8-42d7-90d5-c4a96c911c44 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:49.032162 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e18da1ea-b2c8-42d7-90d5-c4a96c911c44 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:49.077237 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:49.188215 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-e18da1ea-b2c8-42d7-90d5-c4a96c911c44 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.191068 Jun 24 09:42:49.190778 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 57/115] 10.222.0.65 () {60 vars in 1315 bytes} [Fri Jun 24 09:42:48 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69/os-interface => generated 284 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 09:42:49.325550 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-286397e0-114e-45d0-b4c4-32624ce4a46e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:49.326171 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-286397e0-114e-45d0-b4c4-32624ce4a46e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:49.335358 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-286397e0-114e-45d0-b4c4-32624ce4a46e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:49.335935 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-286397e0-114e-45d0-b4c4-32624ce4a46e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:49.336860 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-286397e0-114e-45d0-b4c4-32624ce4a46e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:49.337455 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-286397e0-114e-45d0-b4c4-32624ce4a46e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:49.688643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-286397e0-114e-45d0-b4c4-32624ce4a46e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:49.698074 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:49.702365 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-286397e0-114e-45d0-b4c4-32624ce4a46e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1367 microversion: 2.1 time: 0.381038 Jun 24 09:42:49.713098 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 59/116] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:49 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1367 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:42:49.755623 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ddd8b495-ccf9-4159-99fd-b64a033bd3df tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:49.756240 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ddd8b495-ccf9-4159-99fd-b64a033bd3df tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:49.762659 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ddd8b495-ccf9-4159-99fd-b64a033bd3df tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:49.763384 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ddd8b495-ccf9-4159-99fd-b64a033bd3df tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:49.764321 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ddd8b495-ccf9-4159-99fd-b64a033bd3df tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:49.764904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ddd8b495-ccf9-4159-99fd-b64a033bd3df tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:49.788093 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-0b36bf5a-f768-4910-8ea7-8dad6ce48792 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:49.788873 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-0b36bf5a-f768-4910-8ea7-8dad6ce48792 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:49.802308 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0b36bf5a-f768-4910-8ea7-8dad6ce48792 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:49.802781 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0b36bf5a-f768-4910-8ea7-8dad6ce48792 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:49.803579 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0b36bf5a-f768-4910-8ea7-8dad6ce48792 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:49.804010 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0b36bf5a-f768-4910-8ea7-8dad6ce48792 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:49.935787 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-0b36bf5a-f768-4910-8ea7-8dad6ce48792 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:49.943750 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-0b36bf5a-f768-4910-8ea7-8dad6ce48792 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 200 len: 1265 microversion: 2.1 time: 0.160722 Jun 24 09:42:49.954108 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 60/117] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:49 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:50.363285 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ddd8b495-ccf9-4159-99fd-b64a033bd3df tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:50.374856 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ddd8b495-ccf9-4159-99fd-b64a033bd3df tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1521 microversion: 2.1 time: 0.623069 Jun 24 09:42:50.378310 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 58/118] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:49 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1521 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:50.550804 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-4c3693fb-038d-4da9-9cb0-f8d3d44a9590 req-908e4462-2e04-40ca-b9ab-370bce31dc3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a2b7d9-c03a-459b-9ceb-5d6bf14546ef", "name": "network-vif-plugged", "status": "completed", "tag": "cb40a2d0-f3d7-48fd-97c9-01e1ce70c8c1"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:42:50.569716 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-4c3693fb-038d-4da9-9cb0-f8d3d44a9590 req-908e4462-2e04-40ca-b9ab-370bce31dc3c service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:50.570432 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-4c3693fb-038d-4da9-9cb0-f8d3d44a9590 req-908e4462-2e04-40ca-b9ab-370bce31dc3c service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:50.584158 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-4c3693fb-038d-4da9-9cb0-f8d3d44a9590 req-908e4462-2e04-40ca-b9ab-370bce31dc3c service nova] Creating event network-vif-plugged:cb40a2d0-f3d7-48fd-97c9-01e1ce70c8c1 for instance 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef on hv-cinder-80382 Jun 24 09:42:50.590625 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-4c3693fb-038d-4da9-9cb0-f8d3d44a9590 req-908e4462-2e04-40ca-b9ab-370bce31dc3c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044798 Jun 24 09:42:50.591636 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 61/119] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:42:50.721025 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-698dd9b7-4578-4e6a-9092-1baa41167c6e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:50.721756 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-698dd9b7-4578-4e6a-9092-1baa41167c6e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:50.728212 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-698dd9b7-4578-4e6a-9092-1baa41167c6e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:50.728659 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-698dd9b7-4578-4e6a-9092-1baa41167c6e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:50.729405 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-698dd9b7-4578-4e6a-9092-1baa41167c6e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:50.729949 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-698dd9b7-4578-4e6a-9092-1baa41167c6e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:50.962557 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4d37d7a2-90d5-43f6-bc12-de636b4665de tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:50.963265 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-4d37d7a2-90d5-43f6-bc12-de636b4665de tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:50.970098 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4d37d7a2-90d5-43f6-bc12-de636b4665de tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:50.971798 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4d37d7a2-90d5-43f6-bc12-de636b4665de tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:50.972746 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4d37d7a2-90d5-43f6-bc12-de636b4665de tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:50.973350 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4d37d7a2-90d5-43f6-bc12-de636b4665de tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:51.005740 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-698dd9b7-4578-4e6a-9092-1baa41167c6e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:51.016170 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-698dd9b7-4578-4e6a-9092-1baa41167c6e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1367 microversion: 2.1 time: 0.299006 Jun 24 09:42:51.025606 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 59/120] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:50 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:51.108321 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4d37d7a2-90d5-43f6-bc12-de636b4665de tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:51.116639 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-4d37d7a2-90d5-43f6-bc12-de636b4665de tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 200 len: 1271 microversion: 2.1 time: 0.158355 Jun 24 09:42:51.127298 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 62/121] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:50 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:51.395988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-85e378e4-15b1-449b-9c16-fc2a69cad12f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:51.396604 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-85e378e4-15b1-449b-9c16-fc2a69cad12f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:51.403469 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-85e378e4-15b1-449b-9c16-fc2a69cad12f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:51.403912 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-85e378e4-15b1-449b-9c16-fc2a69cad12f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:51.404858 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-85e378e4-15b1-449b-9c16-fc2a69cad12f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:51.405446 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-85e378e4-15b1-449b-9c16-fc2a69cad12f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:51.629639 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-4905f5a2-b576-4764-a2c8-3297236bb858 req-c33ac02b-8f92-49f5-bd49-485607768d07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa551ac0-154e-4145-acc0-725155004e69", "tag": "371d87f0-d828-436b-a673-c5e34fc40e6c"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:42:51.645864 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-4905f5a2-b576-4764-a2c8-3297236bb858 req-c33ac02b-8f92-49f5-bd49-485607768d07 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:51.647375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-4905f5a2-b576-4764-a2c8-3297236bb858 req-c33ac02b-8f92-49f5-bd49-485607768d07 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:51.659754 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-85e378e4-15b1-449b-9c16-fc2a69cad12f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:51.669064 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-85e378e4-15b1-449b-9c16-fc2a69cad12f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1521 microversion: 2.1 time: 0.277729 Jun 24 09:42:51.669980 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 60/122] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:51 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:51.678819 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-4905f5a2-b576-4764-a2c8-3297236bb858 req-c33ac02b-8f92-49f5-bd49-485607768d07 service nova] Creating event network-changed:371d87f0-d828-436b-a673-c5e34fc40e6c for instance aa551ac0-154e-4145-acc0-725155004e69 on hv-cinder-80382 Jun 24 09:42:51.701470 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-4905f5a2-b576-4764-a2c8-3297236bb858 req-c33ac02b-8f92-49f5-bd49-485607768d07 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073978 Jun 24 09:42:51.702896 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 63/123] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:42:52.033080 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-76ef2555-33ba-4cc8-b540-bf47e42fe2fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:52.033769 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-76ef2555-33ba-4cc8-b540-bf47e42fe2fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:52.040048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-76ef2555-33ba-4cc8-b540-bf47e42fe2fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:52.040571 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-76ef2555-33ba-4cc8-b540-bf47e42fe2fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:52.041247 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-76ef2555-33ba-4cc8-b540-bf47e42fe2fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:52.042444 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-76ef2555-33ba-4cc8-b540-bf47e42fe2fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:52.134912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-da129362-a6ee-4b58-add5-4e26228e6ef0 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:52.135654 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-da129362-a6ee-4b58-add5-4e26228e6ef0 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:52.149541 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-da129362-a6ee-4b58-add5-4e26228e6ef0 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:52.150696 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-da129362-a6ee-4b58-add5-4e26228e6ef0 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:52.152810 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-da129362-a6ee-4b58-add5-4e26228e6ef0 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:52.153657 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-da129362-a6ee-4b58-add5-4e26228e6ef0 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:52.195463 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-76ef2555-33ba-4cc8-b540-bf47e42fe2fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:52.210888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-76ef2555-33ba-4cc8-b540-bf47e42fe2fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1367 microversion: 2.1 time: 0.181581 Jun 24 09:42:52.211982 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 61/124] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:52 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:52.379438 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-da129362-a6ee-4b58-add5-4e26228e6ef0 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:52.388849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-da129362-a6ee-4b58-add5-4e26228e6ef0 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 200 len: 1313 microversion: 2.1 time: 0.258239 Jun 24 09:42:52.390114 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 64/125] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:52 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:52.690584 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ac77fa4f-30d4-4b84-8542-fd960c9e7a57 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:52.691945 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ac77fa4f-30d4-4b84-8542-fd960c9e7a57 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:52.707054 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ac77fa4f-30d4-4b84-8542-fd960c9e7a57 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:52.707736 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ac77fa4f-30d4-4b84-8542-fd960c9e7a57 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:52.708855 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ac77fa4f-30d4-4b84-8542-fd960c9e7a57 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:52.709297 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ac77fa4f-30d4-4b84-8542-fd960c9e7a57 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:52.911357 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ac77fa4f-30d4-4b84-8542-fd960c9e7a57 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:52.922228 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ac77fa4f-30d4-4b84-8542-fd960c9e7a57 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1521 microversion: 2.1 time: 0.238062 Jun 24 09:42:52.923879 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 62/126] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:52 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:53.230880 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a714df7d-a559-4bab-9eee-71baec795e71 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:53.233325 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-a714df7d-a559-4bab-9eee-71baec795e71 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:53.251441 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a714df7d-a559-4bab-9eee-71baec795e71 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:53.252205 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a714df7d-a559-4bab-9eee-71baec795e71 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:53.256653 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a714df7d-a559-4bab-9eee-71baec795e71 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:53.257217 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a714df7d-a559-4bab-9eee-71baec795e71 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:53.409794 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-14eaadfd-ea61-4518-ab91-8f8375d702a2 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:53.410386 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-14eaadfd-ea61-4518-ab91-8f8375d702a2 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:53.416988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-14eaadfd-ea61-4518-ab91-8f8375d702a2 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:53.417819 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-14eaadfd-ea61-4518-ab91-8f8375d702a2 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:53.418793 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-14eaadfd-ea61-4518-ab91-8f8375d702a2 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:53.419410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-14eaadfd-ea61-4518-ab91-8f8375d702a2 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:53.720558 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-a714df7d-a559-4bab-9eee-71baec795e71 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:53.728131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-a714df7d-a559-4bab-9eee-71baec795e71 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1367 microversion: 2.1 time: 0.504361 Jun 24 09:42:53.728707 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 65/127] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:53 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1367 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:53.838330 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-14eaadfd-ea61-4518-ab91-8f8375d702a2 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:53.847846 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-14eaadfd-ea61-4518-ab91-8f8375d702a2 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 200 len: 1313 microversion: 2.1 time: 0.443497 Jun 24 09:42:53.855284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 63/128] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:53 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:53.940841 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-9ca7d50d-1fbb-48c5-820c-39110fc0f2f9 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:53.941632 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-9ca7d50d-1fbb-48c5-820c-39110fc0f2f9 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:53.955240 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9ca7d50d-1fbb-48c5-820c-39110fc0f2f9 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:53.956675 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9ca7d50d-1fbb-48c5-820c-39110fc0f2f9 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:53.959160 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9ca7d50d-1fbb-48c5-820c-39110fc0f2f9 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:53.959786 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9ca7d50d-1fbb-48c5-820c-39110fc0f2f9 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:54.604007 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-9ca7d50d-1fbb-48c5-820c-39110fc0f2f9 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:54.619986 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-9ca7d50d-1fbb-48c5-820c-39110fc0f2f9 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1521 microversion: 2.1 time: 0.680664 Jun 24 09:42:54.623809 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 66/129] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:53 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1521 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:54.751609 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-1bbca262-ff92-4d72-bdde-785124c88bbb tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:54.752787 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-1bbca262-ff92-4d72-bdde-785124c88bbb tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:54.764084 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1bbca262-ff92-4d72-bdde-785124c88bbb tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:54.766581 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1bbca262-ff92-4d72-bdde-785124c88bbb tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:54.767955 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1bbca262-ff92-4d72-bdde-785124c88bbb tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:54.768400 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1bbca262-ff92-4d72-bdde-785124c88bbb tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:54.864140 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-e8ab1522-2942-4707-a83e-df5c2d83765f req-7e8ab92b-0615-44a5-88e2-70d79907ffb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39bd42f5-35d7-4622-9ce8-36a4bcf28fed", "tag": "cc05e753-e2f5-49ee-bcff-8be71968f994"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:42:54.877216 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-e8ab1522-2942-4707-a83e-df5c2d83765f req-7e8ab92b-0615-44a5-88e2-70d79907ffb0 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:54.877734 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-e8ab1522-2942-4707-a83e-df5c2d83765f req-7e8ab92b-0615-44a5-88e2-70d79907ffb0 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:54.890936 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-e8ab1522-2942-4707-a83e-df5c2d83765f req-7e8ab92b-0615-44a5-88e2-70d79907ffb0 service nova] Creating event network-changed:cc05e753-e2f5-49ee-bcff-8be71968f994 for instance 39bd42f5-35d7-4622-9ce8-36a4bcf28fed on hv-cinder-80382 Jun 24 09:42:54.895824 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-e8ab1522-2942-4707-a83e-df5c2d83765f req-7e8ab92b-0615-44a5-88e2-70d79907ffb0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035707 Jun 24 09:42:54.896739 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 67/130] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:42:54.906072 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c2f35115-8d8e-47bb-9e3b-e461abd4edda tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:54.906863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-c2f35115-8d8e-47bb-9e3b-e461abd4edda tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:54.913392 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c2f35115-8d8e-47bb-9e3b-e461abd4edda tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:54.914081 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c2f35115-8d8e-47bb-9e3b-e461abd4edda tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:54.914913 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c2f35115-8d8e-47bb-9e3b-e461abd4edda tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:54.915594 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c2f35115-8d8e-47bb-9e3b-e461abd4edda tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:55.071493 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-1bbca262-ff92-4d72-bdde-785124c88bbb tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:55.082666 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-1bbca262-ff92-4d72-bdde-785124c88bbb tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1367 microversion: 2.1 time: 0.340263 Jun 24 09:42:55.084318 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 64/131] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:54 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1367 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:55.122037 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c2f35115-8d8e-47bb-9e3b-e461abd4edda tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:55.129888 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-c2f35115-8d8e-47bb-9e3b-e461abd4edda tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 200 len: 1313 microversion: 2.1 time: 0.231713 Jun 24 09:42:55.130468 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 68/132] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:54 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:55.638809 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-060624d1-0375-4703-b9f5-0048a403bcaa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:55.639454 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-060624d1-0375-4703-b9f5-0048a403bcaa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:55.647338 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-060624d1-0375-4703-b9f5-0048a403bcaa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:55.648042 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-060624d1-0375-4703-b9f5-0048a403bcaa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:55.648975 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-060624d1-0375-4703-b9f5-0048a403bcaa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:55.649634 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-060624d1-0375-4703-b9f5-0048a403bcaa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:55.814398 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-060624d1-0375-4703-b9f5-0048a403bcaa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:55.823342 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-060624d1-0375-4703-b9f5-0048a403bcaa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1521 microversion: 2.1 time: 0.188585 Jun 24 09:42:55.824181 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 65/133] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:55 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:56.100526 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-46baf7bd-7231-4d4a-9ac8-f82525a58879 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:56.101145 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-46baf7bd-7231-4d4a-9ac8-f82525a58879 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:56.108231 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-46baf7bd-7231-4d4a-9ac8-f82525a58879 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:56.108686 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-46baf7bd-7231-4d4a-9ac8-f82525a58879 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:56.109471 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-46baf7bd-7231-4d4a-9ac8-f82525a58879 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:56.109905 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-46baf7bd-7231-4d4a-9ac8-f82525a58879 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:56.148622 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-fcecd7ab-235c-4ade-8107-f8a33d4a850f tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:56.150015 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-fcecd7ab-235c-4ade-8107-f8a33d4a850f tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:56.160487 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fcecd7ab-235c-4ade-8107-f8a33d4a850f tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:56.161195 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fcecd7ab-235c-4ade-8107-f8a33d4a850f tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:56.162946 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fcecd7ab-235c-4ade-8107-f8a33d4a850f tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:56.163966 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fcecd7ab-235c-4ade-8107-f8a33d4a850f tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:56.325130 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-46baf7bd-7231-4d4a-9ac8-f82525a58879 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:56.334064 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-46baf7bd-7231-4d4a-9ac8-f82525a58879 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1557 microversion: 2.1 time: 0.237485 Jun 24 09:42:56.335595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 69/134] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:56 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1557 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:56.352700 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a580466d-bd36-4bac-99d7-8ec4037e4cfc tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:56.353399 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-a580466d-bd36-4bac-99d7-8ec4037e4cfc tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:56.360766 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a580466d-bd36-4bac-99d7-8ec4037e4cfc tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:56.361256 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a580466d-bd36-4bac-99d7-8ec4037e4cfc tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:56.361955 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-fcecd7ab-235c-4ade-8107-f8a33d4a850f tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:56.362119 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a580466d-bd36-4bac-99d7-8ec4037e4cfc tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:56.362451 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a580466d-bd36-4bac-99d7-8ec4037e4cfc tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:56.379314 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-fcecd7ab-235c-4ade-8107-f8a33d4a850f tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 200 len: 1313 microversion: 2.1 time: 0.234602 Jun 24 09:42:56.395445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 66/135] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:56 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:42:56.476249 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-a580466d-bd36-4bac-99d7-8ec4037e4cfc tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.127828 Jun 24 09:42:56.477175 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 70/136] 10.222.0.65 () {58 vars in 1274 bytes} [Fri Jun 24 09:42:56 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:42:56.842364 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-50a090ae-aca2-414c-bd91-5e0121384aeb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:56.842980 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-50a090ae-aca2-414c-bd91-5e0121384aeb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:56.849824 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-50a090ae-aca2-414c-bd91-5e0121384aeb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:56.850266 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-50a090ae-aca2-414c-bd91-5e0121384aeb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:56.851222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-50a090ae-aca2-414c-bd91-5e0121384aeb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:56.852249 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-50a090ae-aca2-414c-bd91-5e0121384aeb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:57.217037 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-50a090ae-aca2-414c-bd91-5e0121384aeb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:57.241113 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-50a090ae-aca2-414c-bd91-5e0121384aeb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1521 microversion: 2.1 time: 0.403500 Jun 24 09:42:57.243118 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 67/137] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:56 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:57.393582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=2 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:57.394792 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=6 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:57.398994 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b38712d1-01a6-418a-b231-1edde20f20a6 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:57.400000 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-b38712d1-01a6-418a-b231-1edde20f20a6 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:57.406461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b38712d1-01a6-418a-b231-1edde20f20a6 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:57.407054 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b38712d1-01a6-418a-b231-1edde20f20a6 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:57.407853 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b38712d1-01a6-418a-b231-1edde20f20a6 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:57.408508 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b38712d1-01a6-418a-b231-1edde20f20a6 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:57.690466 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b38712d1-01a6-418a-b231-1edde20f20a6 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:57.698675 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b38712d1-01a6-418a-b231-1edde20f20a6 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 200 len: 1313 microversion: 2.1 time: 0.305747 Jun 24 09:42:57.701472 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 71/138] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:57 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:58.091751 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-16bfc752-0eed-4d89-b048-d30ce0d8c365 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:58.092876 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-16bfc752-0eed-4d89-b048-d30ce0d8c365 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:58.097052 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=2 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:58.114813 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-16bfc752-0eed-4d89-b048-d30ce0d8c365 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:58.115729 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-16bfc752-0eed-4d89-b048-d30ce0d8c365 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:58.116772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-16bfc752-0eed-4d89-b048-d30ce0d8c365 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:58.117531 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-16bfc752-0eed-4d89-b048-d30ce0d8c365 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:58.173319 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-16bfc752-0eed-4d89-b048-d30ce0d8c365 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Going to try to terminate instance {{(pid=124338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:42:58.290824 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-87e221a1-2090-47ae-a831-59bccbd088ac tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:58.291578 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-87e221a1-2090-47ae-a831-59bccbd088ac tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:58.302968 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-87e221a1-2090-47ae-a831-59bccbd088ac tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:58.304739 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-87e221a1-2090-47ae-a831-59bccbd088ac tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:58.305967 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-87e221a1-2090-47ae-a831-59bccbd088ac tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:58.306561 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-87e221a1-2090-47ae-a831-59bccbd088ac tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:58.356866 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-16bfc752-0eed-4d89-b048-d30ce0d8c365 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 204 len: 0 microversion: 2.1 time: 0.269152 Jun 24 09:42:58.357890 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 68/139] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:42:58 2022] DELETE /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:42:58.371511 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ab86846d-5d9b-4bf0-b5e2-e791a2808706 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:58.375236 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ab86846d-5d9b-4bf0-b5e2-e791a2808706 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:58.394380 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ab86846d-5d9b-4bf0-b5e2-e791a2808706 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:58.395007 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ab86846d-5d9b-4bf0-b5e2-e791a2808706 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:58.396018 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ab86846d-5d9b-4bf0-b5e2-e791a2808706 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:58.400834 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ab86846d-5d9b-4bf0-b5e2-e791a2808706 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:58.624481 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-87e221a1-2090-47ae-a831-59bccbd088ac tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:58.639903 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-87e221a1-2090-47ae-a831-59bccbd088ac tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1521 microversion: 2.1 time: 0.384196 Jun 24 09:42:58.640584 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 72/140] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:58 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:58.671686 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-b5118c31-bdd3-46c9-a25d-bedca8f8f44f req-94768d2c-d9e9-4803-aa11-0bc286c6a731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93a2b7d9-c03a-459b-9ceb-5d6bf14546ef", "tag": "cb40a2d0-f3d7-48fd-97c9-01e1ce70c8c1"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:42:58.688073 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-b5118c31-bdd3-46c9-a25d-bedca8f8f44f req-94768d2c-d9e9-4803-aa11-0bc286c6a731 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:58.688525 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-b5118c31-bdd3-46c9-a25d-bedca8f8f44f req-94768d2c-d9e9-4803-aa11-0bc286c6a731 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:58.718091 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-b5118c31-bdd3-46c9-a25d-bedca8f8f44f req-94768d2c-d9e9-4803-aa11-0bc286c6a731 service nova] Creating event network-changed:cb40a2d0-f3d7-48fd-97c9-01e1ce70c8c1 for instance 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef on hv-cinder-80382 Jun 24 09:42:58.724667 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-b5118c31-bdd3-46c9-a25d-bedca8f8f44f req-94768d2c-d9e9-4803-aa11-0bc286c6a731 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056672 Jun 24 09:42:58.725342 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 73/141] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:42:58.730554 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e8bee2e2-f32d-44f6-a406-8c9d10d32987 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:58.741909 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e8bee2e2-f32d-44f6-a406-8c9d10d32987 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:58.753715 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e8bee2e2-f32d-44f6-a406-8c9d10d32987 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:58.754169 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e8bee2e2-f32d-44f6-a406-8c9d10d32987 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:58.755091 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e8bee2e2-f32d-44f6-a406-8c9d10d32987 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:58.755565 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e8bee2e2-f32d-44f6-a406-8c9d10d32987 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:58.758704 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ab86846d-5d9b-4bf0-b5e2-e791a2808706 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:58.775385 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ab86846d-5d9b-4bf0-b5e2-e791a2808706 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1554 microversion: 2.1 time: 0.409824 Jun 24 09:42:58.775385 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 69/142] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:58 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1554 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:42:58.944825 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e8bee2e2-f32d-44f6-a406-8c9d10d32987 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:58.952544 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e8bee2e2-f32d-44f6-a406-8c9d10d32987 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 200 len: 1313 microversion: 2.1 time: 0.225982 Jun 24 09:42:58.953349 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 74/143] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:58 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:59.657670 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-1b0d9d19-8b63-4b47-819b-a0cebd37e10f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:59.658414 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-1b0d9d19-8b63-4b47-819b-a0cebd37e10f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:59.666534 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1b0d9d19-8b63-4b47-819b-a0cebd37e10f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:59.667231 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1b0d9d19-8b63-4b47-819b-a0cebd37e10f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:59.668138 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1b0d9d19-8b63-4b47-819b-a0cebd37e10f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:59.668749 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1b0d9d19-8b63-4b47-819b-a0cebd37e10f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:59.792480 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-d17d5759-aab3-4fc3-8290-1460a44e2c5a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:59.794028 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-d17d5759-aab3-4fc3-8290-1460a44e2c5a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:59.806394 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d17d5759-aab3-4fc3-8290-1460a44e2c5a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:59.806971 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d17d5759-aab3-4fc3-8290-1460a44e2c5a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:59.807998 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d17d5759-aab3-4fc3-8290-1460a44e2c5a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:59.809203 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d17d5759-aab3-4fc3-8290-1460a44e2c5a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:59.858742 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-1b0d9d19-8b63-4b47-819b-a0cebd37e10f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:59.859520 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-1b0d9d19-8b63-4b47-819b-a0cebd37e10f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1521 microversion: 2.1 time: 0.205448 Jun 24 09:42:59.866471 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 70/144] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:59 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:42:59.959414 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-d17d5759-aab3-4fc3-8290-1460a44e2c5a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:42:59.970437 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-8aa44fef-052a-4213-8e74-f79eceb500cf tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:42:59.971159 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-8aa44fef-052a-4213-8e74-f79eceb500cf tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:42:59.974904 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-d17d5759-aab3-4fc3-8290-1460a44e2c5a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1554 microversion: 2.1 time: 0.186888 Jun 24 09:42:59.975709 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 75/145] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:59 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1554 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:42:59.987972 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8aa44fef-052a-4213-8e74-f79eceb500cf tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:59.988419 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8aa44fef-052a-4213-8e74-f79eceb500cf tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:42:59.989397 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8aa44fef-052a-4213-8e74-f79eceb500cf tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:42:59.989838 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8aa44fef-052a-4213-8e74-f79eceb500cf tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:00.129718 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-8aa44fef-052a-4213-8e74-f79eceb500cf tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:00.140976 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-8aa44fef-052a-4213-8e74-f79eceb500cf tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 200 len: 1313 microversion: 2.1 time: 0.172185 Jun 24 09:43:00.148120 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 71/146] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:42:59 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:43:00.888305 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-55cc3755-d06f-4136-98dd-d19a2a3dc0ec tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:00.888957 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-55cc3755-d06f-4136-98dd-d19a2a3dc0ec tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:00.896379 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-55cc3755-d06f-4136-98dd-d19a2a3dc0ec tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:00.896831 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-55cc3755-d06f-4136-98dd-d19a2a3dc0ec tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:00.897690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-55cc3755-d06f-4136-98dd-d19a2a3dc0ec tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:00.898168 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-55cc3755-d06f-4136-98dd-d19a2a3dc0ec tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:00.995972 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-cd16230a-13fe-4ffb-bfe6-2aa26b67e3e0 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:00.996953 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-cd16230a-13fe-4ffb-bfe6-2aa26b67e3e0 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:01.008183 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-cd16230a-13fe-4ffb-bfe6-2aa26b67e3e0 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:01.008635 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-cd16230a-13fe-4ffb-bfe6-2aa26b67e3e0 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:01.009411 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-cd16230a-13fe-4ffb-bfe6-2aa26b67e3e0 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:01.009837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-cd16230a-13fe-4ffb-bfe6-2aa26b67e3e0 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:01.070663 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-55cc3755-d06f-4136-98dd-d19a2a3dc0ec tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:01.079292 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-55cc3755-d06f-4136-98dd-d19a2a3dc0ec tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1521 microversion: 2.1 time: 0.194914 Jun 24 09:43:01.079966 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 76/147] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:00 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:01.156559 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-efcee041-830a-410d-9029-dad1e60fa03a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:01.156886 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-efcee041-830a-410d-9029-dad1e60fa03a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:01.163497 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-efcee041-830a-410d-9029-dad1e60fa03a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:01.163694 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-efcee041-830a-410d-9029-dad1e60fa03a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:01.164475 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-efcee041-830a-410d-9029-dad1e60fa03a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:01.164872 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-efcee041-830a-410d-9029-dad1e60fa03a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:01.186255 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-cd16230a-13fe-4ffb-bfe6-2aa26b67e3e0 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:01.188645 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:43:01.196532 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-cd16230a-13fe-4ffb-bfe6-2aa26b67e3e0 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1554 microversion: 2.1 time: 0.206406 Jun 24 09:43:01.197388 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 72/148] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:00 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1554 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:01.445584 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-efcee041-830a-410d-9029-dad1e60fa03a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:01.458244 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-efcee041-830a-410d-9029-dad1e60fa03a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 200 len: 1313 microversion: 2.1 time: 0.306400 Jun 24 09:43:01.467715 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 77/149] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:01 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:01.942053 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-5d5a1f1a-211e-4d0f-80be-848d44ce4e00 req-710a7e26-05f7-4a7e-9b5d-bdfc9f427a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce878530-09af-4e67-9276-7b448c325d2f", "name": "network-vif-deleted", "tag": "697f8edd-0704-4e42-8528-68705e30c6e2"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:43:01.953532 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-5d5a1f1a-211e-4d0f-80be-848d44ce4e00 req-710a7e26-05f7-4a7e-9b5d-bdfc9f427a97 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:01.954215 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-5d5a1f1a-211e-4d0f-80be-848d44ce4e00 req-710a7e26-05f7-4a7e-9b5d-bdfc9f427a97 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:01.973801 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-5d5a1f1a-211e-4d0f-80be-848d44ce4e00 req-710a7e26-05f7-4a7e-9b5d-bdfc9f427a97 service nova] Creating event network-vif-deleted:697f8edd-0704-4e42-8528-68705e30c6e2 for instance ce878530-09af-4e67-9276-7b448c325d2f on hv-cinder-80382 Jun 24 09:43:01.980364 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-5d5a1f1a-211e-4d0f-80be-848d44ce4e00 req-710a7e26-05f7-4a7e-9b5d-bdfc9f427a97 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046407 Jun 24 09:43:01.981947 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 73/150] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:43:02.096263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-64d14a5a-d9d4-48e5-b98d-8a9af6bab11e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:02.096893 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-64d14a5a-d9d4-48e5-b98d-8a9af6bab11e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:02.102798 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-64d14a5a-d9d4-48e5-b98d-8a9af6bab11e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:02.103284 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-64d14a5a-d9d4-48e5-b98d-8a9af6bab11e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:02.104087 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-64d14a5a-d9d4-48e5-b98d-8a9af6bab11e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:02.104733 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-64d14a5a-d9d4-48e5-b98d-8a9af6bab11e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:02.215176 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-145ec85f-d0c7-43e6-9b67-494e09ef81a3 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:02.215800 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-145ec85f-d0c7-43e6-9b67-494e09ef81a3 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:02.223159 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-145ec85f-d0c7-43e6-9b67-494e09ef81a3 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:02.223821 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-145ec85f-d0c7-43e6-9b67-494e09ef81a3 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:02.224743 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-145ec85f-d0c7-43e6-9b67-494e09ef81a3 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:02.225320 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-145ec85f-d0c7-43e6-9b67-494e09ef81a3 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:02.249477 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-64d14a5a-d9d4-48e5-b98d-8a9af6bab11e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:02.259450 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-64d14a5a-d9d4-48e5-b98d-8a9af6bab11e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1521 microversion: 2.1 time: 0.166635 Jun 24 09:43:02.260334 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 78/151] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:02 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:02.305449 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-145ec85f-d0c7-43e6-9b67-494e09ef81a3 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1722779f6b74af59fa05a2b63890b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290bd187dc948bc9f1dc5a8cc272f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:02.314466 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-145ec85f-d0c7-43e6-9b67-494e09ef81a3 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 200 len: 1345 microversion: 2.1 time: 0.104512 Jun 24 09:43:02.315259 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 74/152] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:02 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 1345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:43:02.476656 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c72737b3-ad89-4d71-a316-424c75f917ee tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:02.477274 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-c72737b3-ad89-4d71-a316-424c75f917ee tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:02.484376 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c72737b3-ad89-4d71-a316-424c75f917ee tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:02.484841 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c72737b3-ad89-4d71-a316-424c75f917ee tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:02.485825 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c72737b3-ad89-4d71-a316-424c75f917ee tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:02.486477 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c72737b3-ad89-4d71-a316-424c75f917ee tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:02.506040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=100 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:43:02.624732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c72737b3-ad89-4d71-a316-424c75f917ee tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:02.632780 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-c72737b3-ad89-4d71-a316-424c75f917ee tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 200 len: 1313 microversion: 2.1 time: 0.160114 Jun 24 09:43:02.633572 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 79/153] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:02 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:03.278563 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-fcbc38d5-9507-4dbf-b9cb-65c2deed1fdb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:03.279344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-fcbc38d5-9507-4dbf-b9cb-65c2deed1fdb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:03.286089 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fcbc38d5-9507-4dbf-b9cb-65c2deed1fdb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:03.286973 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fcbc38d5-9507-4dbf-b9cb-65c2deed1fdb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:03.288006 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fcbc38d5-9507-4dbf-b9cb-65c2deed1fdb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:03.288509 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fcbc38d5-9507-4dbf-b9cb-65c2deed1fdb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:03.334424 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3541ac44-04d0-4481-9b43-ff2691e4d12e tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:03.336117 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3541ac44-04d0-4481-9b43-ff2691e4d12e tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:03.345071 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3541ac44-04d0-4481-9b43-ff2691e4d12e tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:03.345852 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3541ac44-04d0-4481-9b43-ff2691e4d12e tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:03.346878 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3541ac44-04d0-4481-9b43-ff2691e4d12e tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:03.347647 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3541ac44-04d0-4481-9b43-ff2691e4d12e tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:03.365454 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-3541ac44-04d0-4481-9b43-ff2691e4d12e tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] HTTP exception thrown: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. Jun 24 09:43:03.390448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3541ac44-04d0-4481-9b43-ff2691e4d12e tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Request method failure captured: Jun 24 09:43:03.390448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f HTTP/1.1 Jun 24 09:43:03.390448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:43:03.390448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:43:03.390448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:43:03.390448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:43:03.390448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:43:03.390448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:43:03.390448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:43:03.390448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:43:03.390448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYbgGDZ41IXL6Aqu68n_J8TDqaHBKYLYIWC5Z4QTGFaGrI4XpCH6MuIxLyZbI4Xj-TJ0_A_u-pzzFEipzg9v_GovYdiWOfrga7CJRR6HNa8HqGj9wK4IECkUrFJgC7ft4ut0ndc3VD_JW8ZaHSr014YEjJIY4gj-AmlcM8nYXeZ73jk Jun 24 09:43:03.390448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:43:03.390448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:43:03.390448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:43:03.390448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:43:03.390448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:43:03.390448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:43:03.390448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 4290bd187dc948bc9f1dc5a8cc272f0b Jun 24 09:43:03.390448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-DeleteServersTestJSON-839974816 Jun 24 09:43:03.390448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:43:03.390448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:43:03.391915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4290bd187dc948bc9f1dc5a8cc272f0b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4290bd187dc948bc9f1dc5a8cc272f0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4290bd187dc948bc9f1dc5a8cc272f0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4290bd187dc948bc9f1dc5a8cc272f0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:43:03.391915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-DeleteServersTestJSON-839974816 Jun 24 09:43:03.391915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 4290bd187dc948bc9f1dc5a8cc272f0b Jun 24 09:43:03.391915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-DeleteServersTestJSON-839974816 Jun 24 09:43:03.391915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-DeleteServersTestJSON-839974816-project Jun 24 09:43:03.391915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:43:03.391915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:43:03.391915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: f1722779f6b74af59fa05a2b63890b2d Jun 24 09:43:03.391915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-DeleteServersTestJSON-839974816-project Jun 24 09:43:03.391915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:43:03.391915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. Jun 24 09:43:03.391915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': 'ce878530-09af-4e67-9276-7b448c325d2f'} Jun 24 09:43:03.392863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:43:03.392863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:43:03.392863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:43:03.392863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:43:03.392863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:43:03.392863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:43:03.392863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:43:03.392863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:43:03.392863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:43:03.392863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:43:03.392863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. Jun 24 09:43:03.392863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:03.392863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:43:03.392863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:03.392863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:43:03.392863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:43:03.392863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:43:03.392863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:43:03.392863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:43:03.392863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:43:03.394318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:43:03.394318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:43:03.394318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:43:03.394318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:43:03.394318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:43:03.394318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:43:03.394318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:43:03.394318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. Jun 24 09:43:03.394318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:03.394318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:43:03.394318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:03.394318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:43:03.394318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:43:03.394318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:43:03.394318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:43:03.394318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:43:03.394318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. Jun 24 09:43:03.394318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:03.396536 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3541ac44-04d0-4481-9b43-ff2691e4d12e tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Returning 404 to user: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:43:03.397484 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3541ac44-04d0-4481-9b43-ff2691e4d12e tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 404 len: 111 microversion: 2.1 time: 0.069030 Jun 24 09:43:03.401472 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 80/154] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:03 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:43:03.462254 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-fcbc38d5-9507-4dbf-b9cb-65c2deed1fdb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:03.470917 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-fcbc38d5-9507-4dbf-b9cb-65c2deed1fdb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1521 microversion: 2.1 time: 0.197864 Jun 24 09:43:03.472069 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 75/155] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:03 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:43:03.517693 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b0631379-c73b-474c-8f08-8ef96d329f14 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:03.518738 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-b0631379-c73b-474c-8f08-8ef96d329f14 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:03.524834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b0631379-c73b-474c-8f08-8ef96d329f14 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:03.525281 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b0631379-c73b-474c-8f08-8ef96d329f14 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:03.526036 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b0631379-c73b-474c-8f08-8ef96d329f14 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:03.526577 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b0631379-c73b-474c-8f08-8ef96d329f14 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:03.539649 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-b0631379-c73b-474c-8f08-8ef96d329f14 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] HTTP exception thrown: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. Jun 24 09:43:03.548131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b0631379-c73b-474c-8f08-8ef96d329f14 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Request method failure captured: Jun 24 09:43:03.548131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f/os-volume_attachments HTTP/1.1 Jun 24 09:43:03.548131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:43:03.548131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:43:03.548131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:43:03.548131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:43:03.548131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:43:03.548131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:43:03.548131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:43:03.548131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:43:03.548131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYbgGDZ41IXL6Aqu68n_J8TDqaHBKYLYIWC5Z4QTGFaGrI4XpCH6MuIxLyZbI4Xj-TJ0_A_u-pzzFEipzg9v_GovYdiWOfrga7CJRR6HNa8HqGj9wK4IECkUrFJgC7ft4ut0ndc3VD_JW8ZaHSr014YEjJIY4gj-AmlcM8nYXeZ73jk Jun 24 09:43:03.548131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:43:03.548131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:43:03.548131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:43:03.548131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:43:03.548131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:43:03.548131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:43:03.548131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 4290bd187dc948bc9f1dc5a8cc272f0b Jun 24 09:43:03.548131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-DeleteServersTestJSON-839974816 Jun 24 09:43:03.548131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:43:03.548131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:43:03.549552 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4290bd187dc948bc9f1dc5a8cc272f0b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4290bd187dc948bc9f1dc5a8cc272f0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4290bd187dc948bc9f1dc5a8cc272f0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4290bd187dc948bc9f1dc5a8cc272f0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:43:03.549552 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-DeleteServersTestJSON-839974816 Jun 24 09:43:03.549552 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 4290bd187dc948bc9f1dc5a8cc272f0b Jun 24 09:43:03.549552 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-DeleteServersTestJSON-839974816 Jun 24 09:43:03.549552 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-DeleteServersTestJSON-839974816-project Jun 24 09:43:03.549552 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:43:03.549552 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:43:03.549552 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: f1722779f6b74af59fa05a2b63890b2d Jun 24 09:43:03.549552 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-DeleteServersTestJSON-839974816-project Jun 24 09:43:03.549552 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:43:03.549552 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. Jun 24 09:43:03.549552 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'server_id': 'ce878530-09af-4e67-9276-7b448c325d2f'} Jun 24 09:43:03.550337 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:43:03.550337 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:43:03.550337 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:43:03.550337 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:43:03.550337 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:43:03.550337 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:43:03.550337 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:43:03.550337 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:43:03.550337 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:43:03.550337 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:43:03.550337 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. Jun 24 09:43:03.550337 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:03.550337 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:43:03.550337 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:03.550337 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:43:03.550337 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:43:03.550337 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:43:03.550337 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:43:03.550337 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:43:03.550337 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:43:03.551640 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:43:03.551640 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 24 09:43:03.551640 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 09:43:03.551640 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 24 09:43:03.551640 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 09:43:03.551640 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 24 09:43:03.551640 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 24 09:43:03.551640 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:43:03.551640 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:43:03.551640 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. Jun 24 09:43:03.551640 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:03.551640 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:43:03.551640 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:03.551640 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:43:03.551640 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:43:03.551640 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:43:03.551640 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:43:03.551640 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:43:03.551640 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. Jun 24 09:43:03.551640 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:03.552904 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b0631379-c73b-474c-8f08-8ef96d329f14 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Returning 404 to user: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:43:03.552904 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b0631379-c73b-474c-8f08-8ef96d329f14 tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036078 Jun 24 09:43:03.552904 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 81/156] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:43:03 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:43:03.650429 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-990ea035-e31c-495f-ad7d-c2de3bdc61c0 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:03.652326 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-990ea035-e31c-495f-ad7d-c2de3bdc61c0 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:03.659775 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-990ea035-e31c-495f-ad7d-c2de3bdc61c0 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:03.660297 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-990ea035-e31c-495f-ad7d-c2de3bdc61c0 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:03.661401 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-990ea035-e31c-495f-ad7d-c2de3bdc61c0 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:03.661794 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-990ea035-e31c-495f-ad7d-c2de3bdc61c0 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:03.800156 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-990ea035-e31c-495f-ad7d-c2de3bdc61c0 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:03.808214 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-990ea035-e31c-495f-ad7d-c2de3bdc61c0 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 200 len: 1313 microversion: 2.1 time: 0.161880 Jun 24 09:43:03.808760 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 76/157] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:03 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:04.495939 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b6ee45d0-ef12-4f16-a748-acad028aba5a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:04.496824 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-b6ee45d0-ef12-4f16-a748-acad028aba5a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:04.505317 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b6ee45d0-ef12-4f16-a748-acad028aba5a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:04.505938 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b6ee45d0-ef12-4f16-a748-acad028aba5a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:04.506960 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b6ee45d0-ef12-4f16-a748-acad028aba5a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:04.507527 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b6ee45d0-ef12-4f16-a748-acad028aba5a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:04.670010 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b6ee45d0-ef12-4f16-a748-acad028aba5a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:04.679738 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b6ee45d0-ef12-4f16-a748-acad028aba5a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1521 microversion: 2.1 time: 0.195415 Jun 24 09:43:04.680383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 82/158] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:04 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:04.824795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-9bff55c6-af55-496d-a154-95a763e2bf07 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:04.825680 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-9bff55c6-af55-496d-a154-95a763e2bf07 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:04.836040 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9bff55c6-af55-496d-a154-95a763e2bf07 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:04.836488 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9bff55c6-af55-496d-a154-95a763e2bf07 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:04.837260 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9bff55c6-af55-496d-a154-95a763e2bf07 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:04.837688 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9bff55c6-af55-496d-a154-95a763e2bf07 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:04.843826 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3e762d1e-350e-427d-9017-5d15247e5c8a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:04.844529 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3e762d1e-350e-427d-9017-5d15247e5c8a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:04.854208 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3e762d1e-350e-427d-9017-5d15247e5c8a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:04.855026 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3e762d1e-350e-427d-9017-5d15247e5c8a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:04.857531 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3e762d1e-350e-427d-9017-5d15247e5c8a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:04.858258 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3e762d1e-350e-427d-9017-5d15247e5c8a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:04.876039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-3e762d1e-350e-427d-9017-5d15247e5c8a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] HTTP exception thrown: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. Jun 24 09:43:04.878050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3e762d1e-350e-427d-9017-5d15247e5c8a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Request method failure captured: Jun 24 09:43:04.878050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: DELETE /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f HTTP/1.1 Jun 24 09:43:04.878050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:43:04.878050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:43:04.878050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:43:04.878050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:43:04.878050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:43:04.878050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:43:04.878050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:43:04.878050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:43:04.878050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYbgGDZ41IXL6Aqu68n_J8TDqaHBKYLYIWC5Z4QTGFaGrI4XpCH6MuIxLyZbI4Xj-TJ0_A_u-pzzFEipzg9v_GovYdiWOfrga7CJRR6HNa8HqGj9wK4IECkUrFJgC7ft4ut0ndc3VD_JW8ZaHSr014YEjJIY4gj-AmlcM8nYXeZ73jk Jun 24 09:43:04.878050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:43:04.878050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:43:04.878050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:43:04.878050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:43:04.878050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:43:04.878050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:43:04.878050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 4290bd187dc948bc9f1dc5a8cc272f0b Jun 24 09:43:04.878050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-DeleteServersTestJSON-839974816 Jun 24 09:43:04.878050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:43:04.878050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:43:04.879467 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4290bd187dc948bc9f1dc5a8cc272f0b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4290bd187dc948bc9f1dc5a8cc272f0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4290bd187dc948bc9f1dc5a8cc272f0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4290bd187dc948bc9f1dc5a8cc272f0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:43:04.879467 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-DeleteServersTestJSON-839974816 Jun 24 09:43:04.879467 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 4290bd187dc948bc9f1dc5a8cc272f0b Jun 24 09:43:04.879467 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-DeleteServersTestJSON-839974816 Jun 24 09:43:04.879467 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-DeleteServersTestJSON-839974816-project Jun 24 09:43:04.879467 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:43:04.879467 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:43:04.879467 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: f1722779f6b74af59fa05a2b63890b2d Jun 24 09:43:04.879467 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-DeleteServersTestJSON-839974816-project Jun 24 09:43:04.879467 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:43:04.879467 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. Jun 24 09:43:04.879467 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': 'ce878530-09af-4e67-9276-7b448c325d2f'} Jun 24 09:43:04.880315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:43:04.880315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:43:04.880315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:43:04.880315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:43:04.880315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:43:04.880315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:43:04.880315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:43:04.880315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:43:04.880315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:43:04.880315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:43:04.880315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. Jun 24 09:43:04.880315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:04.880315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:43:04.880315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:04.880315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:43:04.880315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:43:04.880315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:43:04.880315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:43:04.880315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:43:04.880315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:43:04.881547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:43:04.881547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 09:43:04.881547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 09:43:04.881547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 09:43:04.881547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 09:43:04.881547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:43:04.881547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:43:04.881547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:43:04.881547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:43:04.881547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. Jun 24 09:43:04.881547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:04.881547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:43:04.881547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:04.881547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:43:04.881547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:43:04.881547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:43:04.881547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:43:04.881547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:43:04.881547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. Jun 24 09:43:04.881547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:04.884991 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3e762d1e-350e-427d-9017-5d15247e5c8a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Returning 404 to user: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:43:04.888937 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3e762d1e-350e-427d-9017-5d15247e5c8a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 404 len: 111 microversion: 2.1 time: 0.049280 Jun 24 09:43:04.890044 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 83/159] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:43:04 2022] DELETE /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:43:04.910855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7c9b167d-c5fa-4da8-bee2-eb399d896e4a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:04.911664 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-7c9b167d-c5fa-4da8-bee2-eb399d896e4a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] [instance: ce878530-09af-4e67-9276-7b448c325d2f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:04.922253 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7c9b167d-c5fa-4da8-bee2-eb399d896e4a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:04.922697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7c9b167d-c5fa-4da8-bee2-eb399d896e4a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:04.923496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7c9b167d-c5fa-4da8-bee2-eb399d896e4a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:04.923935 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7c9b167d-c5fa-4da8-bee2-eb399d896e4a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:04.953307 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-7c9b167d-c5fa-4da8-bee2-eb399d896e4a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] HTTP exception thrown: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. Jun 24 09:43:04.956530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7c9b167d-c5fa-4da8-bee2-eb399d896e4a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Request method failure captured: Jun 24 09:43:04.956530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f HTTP/1.1 Jun 24 09:43:04.956530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:43:04.956530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:43:04.956530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:43:04.956530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:43:04.956530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:43:04.956530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:43:04.956530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:43:04.956530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:43:04.956530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYbgGDZ41IXL6Aqu68n_J8TDqaHBKYLYIWC5Z4QTGFaGrI4XpCH6MuIxLyZbI4Xj-TJ0_A_u-pzzFEipzg9v_GovYdiWOfrga7CJRR6HNa8HqGj9wK4IECkUrFJgC7ft4ut0ndc3VD_JW8ZaHSr014YEjJIY4gj-AmlcM8nYXeZ73jk Jun 24 09:43:04.956530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:43:04.956530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:43:04.956530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:43:04.956530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:43:04.956530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:43:04.956530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:43:04.956530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 4290bd187dc948bc9f1dc5a8cc272f0b Jun 24 09:43:04.956530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-DeleteServersTestJSON-839974816 Jun 24 09:43:04.956530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:43:04.956530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:43:04.957746 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4290bd187dc948bc9f1dc5a8cc272f0b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4290bd187dc948bc9f1dc5a8cc272f0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4290bd187dc948bc9f1dc5a8cc272f0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4290bd187dc948bc9f1dc5a8cc272f0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:43:04.957746 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-DeleteServersTestJSON-839974816 Jun 24 09:43:04.957746 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 4290bd187dc948bc9f1dc5a8cc272f0b Jun 24 09:43:04.957746 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-DeleteServersTestJSON-839974816 Jun 24 09:43:04.957746 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-DeleteServersTestJSON-839974816-project Jun 24 09:43:04.957746 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:43:04.957746 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:43:04.957746 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: f1722779f6b74af59fa05a2b63890b2d Jun 24 09:43:04.957746 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-DeleteServersTestJSON-839974816-project Jun 24 09:43:04.957746 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:43:04.957746 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. Jun 24 09:43:04.957746 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': 'ce878530-09af-4e67-9276-7b448c325d2f'} Jun 24 09:43:04.958373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:43:04.958373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:43:04.958373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:43:04.958373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:43:04.958373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:43:04.958373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:43:04.958373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:43:04.958373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:43:04.958373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:43:04.958373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:43:04.958373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. Jun 24 09:43:04.958373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:04.958373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:43:04.958373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:04.958373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:43:04.958373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:43:04.958373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:43:04.958373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:43:04.958373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:43:04.958373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:43:04.959425 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:43:04.959425 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:43:04.959425 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:43:04.959425 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:43:04.959425 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:43:04.959425 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:43:04.959425 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:43:04.959425 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. Jun 24 09:43:04.959425 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:04.959425 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:43:04.959425 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:04.959425 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:43:04.959425 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:43:04.959425 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:43:04.959425 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:43:04.959425 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:43:04.959425 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. Jun 24 09:43:04.959425 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:04.962086 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7c9b167d-c5fa-4da8-bee2-eb399d896e4a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] Returning 404 to user: Instance ce878530-09af-4e67-9276-7b448c325d2f could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:43:04.963046 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-7c9b167d-c5fa-4da8-bee2-eb399d896e4a tempest-DeleteServersTestJSON-839974816 tempest-DeleteServersTestJSON-839974816-project] 10.222.0.65 "GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f" status: 404 len: 111 microversion: 2.1 time: 0.069057 Jun 24 09:43:04.967225 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 84/160] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:04 2022] GET /compute/v2.1/servers/ce878530-09af-4e67-9276-7b448c325d2f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 09:43:04.987705 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-9bff55c6-af55-496d-a154-95a763e2bf07 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:04.996909 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-9bff55c6-af55-496d-a154-95a763e2bf07 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 200 len: 1313 microversion: 2.1 time: 0.175828 Jun 24 09:43:04.998743 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 77/161] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:04 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:05.455226 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-b96fe280-eeb0-43ef-b507-42ca9edbfda4 req-8055eb5c-9fbc-4eca-a2f8-946e3c03a242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39bd42f5-35d7-4622-9ce8-36a4bcf28fed", "name": "network-vif-plugged", "status": "completed", "tag": "cc05e753-e2f5-49ee-bcff-8be71968f994"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:43:05.464905 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-b96fe280-eeb0-43ef-b507-42ca9edbfda4 req-8055eb5c-9fbc-4eca-a2f8-946e3c03a242 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:05.465700 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-b96fe280-eeb0-43ef-b507-42ca9edbfda4 req-8055eb5c-9fbc-4eca-a2f8-946e3c03a242 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:05.484651 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-b96fe280-eeb0-43ef-b507-42ca9edbfda4 req-8055eb5c-9fbc-4eca-a2f8-946e3c03a242 service nova] Creating event network-vif-plugged:cc05e753-e2f5-49ee-bcff-8be71968f994 for instance 39bd42f5-35d7-4622-9ce8-36a4bcf28fed on hv-cinder-80382 Jun 24 09:43:05.492632 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-b96fe280-eeb0-43ef-b507-42ca9edbfda4 req-8055eb5c-9fbc-4eca-a2f8-946e3c03a242 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040667 Jun 24 09:43:05.494016 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 85/162] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:43:05.697934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-3da7a341-1653-4eb7-9650-7c21e159357a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:05.698542 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-3da7a341-1653-4eb7-9650-7c21e159357a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:05.705838 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3da7a341-1653-4eb7-9650-7c21e159357a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:05.706500 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3da7a341-1653-4eb7-9650-7c21e159357a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:05.707676 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3da7a341-1653-4eb7-9650-7c21e159357a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:05.708108 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3da7a341-1653-4eb7-9650-7c21e159357a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:05.881687 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-3da7a341-1653-4eb7-9650-7c21e159357a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:05.890255 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-3da7a341-1653-4eb7-9650-7c21e159357a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1521 microversion: 2.1 time: 0.196151 Jun 24 09:43:05.890765 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 78/163] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:05 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:06.016471 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4696aee0-efb2-445b-bbb1-38a1d5f54798 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:06.018182 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-4696aee0-efb2-445b-bbb1-38a1d5f54798 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:06.024129 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4696aee0-efb2-445b-bbb1-38a1d5f54798 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:06.024575 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4696aee0-efb2-445b-bbb1-38a1d5f54798 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:06.025336 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4696aee0-efb2-445b-bbb1-38a1d5f54798 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:06.025768 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4696aee0-efb2-445b-bbb1-38a1d5f54798 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:06.199411 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4696aee0-efb2-445b-bbb1-38a1d5f54798 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:06.210359 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-4696aee0-efb2-445b-bbb1-38a1d5f54798 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 200 len: 1313 microversion: 2.1 time: 0.199672 Jun 24 09:43:06.211528 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 86/164] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:06 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:06.907759 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-f8d99469-9edb-4ef9-8c2e-c2c8c7360bca tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:06.908902 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-f8d99469-9edb-4ef9-8c2e-c2c8c7360bca tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:06.926859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f8d99469-9edb-4ef9-8c2e-c2c8c7360bca tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:06.927380 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f8d99469-9edb-4ef9-8c2e-c2c8c7360bca tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:06.928164 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f8d99469-9edb-4ef9-8c2e-c2c8c7360bca tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:06.928619 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f8d99469-9edb-4ef9-8c2e-c2c8c7360bca tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:07.116710 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f8d99469-9edb-4ef9-8c2e-c2c8c7360bca tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:07.129236 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-f8d99469-9edb-4ef9-8c2e-c2c8c7360bca tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1521 microversion: 2.1 time: 0.224983 Jun 24 09:43:07.131527 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 79/165] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:06 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:07.227209 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b320f95f-9752-4173-8553-0d0fb5c29ae1 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:07.228627 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-b320f95f-9752-4173-8553-0d0fb5c29ae1 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:07.235481 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b320f95f-9752-4173-8553-0d0fb5c29ae1 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:07.235997 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b320f95f-9752-4173-8553-0d0fb5c29ae1 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:07.236836 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b320f95f-9752-4173-8553-0d0fb5c29ae1 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:07.237333 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b320f95f-9752-4173-8553-0d0fb5c29ae1 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:07.374775 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b320f95f-9752-4173-8553-0d0fb5c29ae1 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:07.387827 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b320f95f-9752-4173-8553-0d0fb5c29ae1 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 200 len: 1313 microversion: 2.1 time: 0.164572 Jun 24 09:43:07.388622 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 87/166] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:07 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:08.152241 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-bddd671f-148b-4a49-8f0e-147d2dc7b389 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:08.152869 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-bddd671f-148b-4a49-8f0e-147d2dc7b389 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:08.165446 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-bddd671f-148b-4a49-8f0e-147d2dc7b389 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:08.165992 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-bddd671f-148b-4a49-8f0e-147d2dc7b389 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:08.167100 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-bddd671f-148b-4a49-8f0e-147d2dc7b389 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:08.168211 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-bddd671f-148b-4a49-8f0e-147d2dc7b389 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:08.350466 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-bddd671f-148b-4a49-8f0e-147d2dc7b389 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:08.359730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-bddd671f-148b-4a49-8f0e-147d2dc7b389 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1521 microversion: 2.1 time: 0.211295 Jun 24 09:43:08.360327 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 80/167] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:08 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:08.405647 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b7c64a79-7051-4d26-a0ef-d57c8c919c8a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:08.406261 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-b7c64a79-7051-4d26-a0ef-d57c8c919c8a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:08.414431 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b7c64a79-7051-4d26-a0ef-d57c8c919c8a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:08.415144 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b7c64a79-7051-4d26-a0ef-d57c8c919c8a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:08.415920 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b7c64a79-7051-4d26-a0ef-d57c8c919c8a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:08.416358 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b7c64a79-7051-4d26-a0ef-d57c8c919c8a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:08.559093 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b7c64a79-7051-4d26-a0ef-d57c8c919c8a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:08.568342 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b7c64a79-7051-4d26-a0ef-d57c8c919c8a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 200 len: 1497 microversion: 2.1 time: 0.167106 Jun 24 09:43:08.568935 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 88/168] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:08 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:09.048229 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-fd7da5ee-b749-4622-933b-474a34dafba5 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:09.048722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-fd7da5ee-b749-4622-933b-474a34dafba5 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:09.055111 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fd7da5ee-b749-4622-933b-474a34dafba5 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:09.055652 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fd7da5ee-b749-4622-933b-474a34dafba5 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:09.056422 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fd7da5ee-b749-4622-933b-474a34dafba5 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:09.056852 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fd7da5ee-b749-4622-933b-474a34dafba5 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:09.083939 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-fd7da5ee-b749-4622-933b-474a34dafba5 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Going to try to terminate instance {{(pid=124338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:43:09.204354 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-fd7da5ee-b749-4622-933b-474a34dafba5 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "DELETE /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 204 len: 0 microversion: 2.1 time: 0.160497 Jun 24 09:43:09.210983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 81/169] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:43:09 2022] DELETE /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:43:09.225790 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-8a52aaee-b58f-4b5e-b4d7-169c1fec7cf6 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:09.227426 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-8a52aaee-b58f-4b5e-b4d7-169c1fec7cf6 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:09.244103 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8a52aaee-b58f-4b5e-b4d7-169c1fec7cf6 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:09.244730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8a52aaee-b58f-4b5e-b4d7-169c1fec7cf6 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:09.259732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8a52aaee-b58f-4b5e-b4d7-169c1fec7cf6 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:09.260187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8a52aaee-b58f-4b5e-b4d7-169c1fec7cf6 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:09.378220 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-b4593570-cd7c-48e9-b3ad-c3a0790592d5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:09.379035 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-b4593570-cd7c-48e9-b3ad-c3a0790592d5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:09.387436 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b4593570-cd7c-48e9-b3ad-c3a0790592d5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:09.387956 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b4593570-cd7c-48e9-b3ad-c3a0790592d5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:09.388935 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b4593570-cd7c-48e9-b3ad-c3a0790592d5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:09.389562 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b4593570-cd7c-48e9-b3ad-c3a0790592d5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:09.483275 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-8a52aaee-b58f-4b5e-b4d7-169c1fec7cf6 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:09.495385 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-8a52aaee-b58f-4b5e-b4d7-169c1fec7cf6 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 200 len: 1503 microversion: 2.1 time: 0.283749 Jun 24 09:43:09.498225 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 89/170] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:09 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 1503 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:43:09.558934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-b4593570-cd7c-48e9-b3ad-c3a0790592d5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:09.568309 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-b4593570-cd7c-48e9-b3ad-c3a0790592d5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1521 microversion: 2.1 time: 0.195164 Jun 24 09:43:09.577285 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 82/171] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:09 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:43:10.515204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-526a0283-dca4-43ea-af2c-56ea53712d4a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:10.515791 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-526a0283-dca4-43ea-af2c-56ea53712d4a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:10.523583 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-526a0283-dca4-43ea-af2c-56ea53712d4a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:10.524059 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-526a0283-dca4-43ea-af2c-56ea53712d4a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:10.524834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-526a0283-dca4-43ea-af2c-56ea53712d4a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:10.525301 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-526a0283-dca4-43ea-af2c-56ea53712d4a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:10.587182 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-1bb4dc88-66a3-4993-b2da-1c6295a09800 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:10.587800 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-1bb4dc88-66a3-4993-b2da-1c6295a09800 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:10.590697 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:43:10.601745 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1bb4dc88-66a3-4993-b2da-1c6295a09800 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:10.602153 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1bb4dc88-66a3-4993-b2da-1c6295a09800 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:10.607419 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1bb4dc88-66a3-4993-b2da-1c6295a09800 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:10.607946 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1bb4dc88-66a3-4993-b2da-1c6295a09800 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:10.780047 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-526a0283-dca4-43ea-af2c-56ea53712d4a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:10.788745 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-526a0283-dca4-43ea-af2c-56ea53712d4a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 200 len: 1503 microversion: 2.1 time: 0.277893 Jun 24 09:43:10.789451 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 90/172] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:10 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 1503 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:10.841820 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-1bb4dc88-66a3-4993-b2da-1c6295a09800 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:10.849785 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-1bb4dc88-66a3-4993-b2da-1c6295a09800 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1501 microversion: 2.1 time: 0.268319 Jun 24 09:43:10.850976 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 83/173] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:10 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1501 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:43:10.867190 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-d46f492e-5c3f-48ff-9648-98be5a6fc494 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:10.868080 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-d46f492e-5c3f-48ff-9648-98be5a6fc494 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:10.874948 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d46f492e-5c3f-48ff-9648-98be5a6fc494 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:10.875782 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d46f492e-5c3f-48ff-9648-98be5a6fc494 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:10.876754 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d46f492e-5c3f-48ff-9648-98be5a6fc494 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:10.877483 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d46f492e-5c3f-48ff-9648-98be5a6fc494 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:11.027067 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-d46f492e-5c3f-48ff-9648-98be5a6fc494 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:11.035721 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-d46f492e-5c3f-48ff-9648-98be5a6fc494 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1515 microversion: 2.1 time: 0.172635 Jun 24 09:43:11.036574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 91/174] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:10 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:11.732290 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-0c244a73-c240-4d19-a3aa-04798b0676dd tempest-VolumesTestJSON-1495767864 tempest-VolumesTestJSON-1495767864-project] Calling method '.version_select at 0x7fc6d4eb2b80>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:11.794442 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-0c244a73-c240-4d19-a3aa-04798b0676dd tempest-VolumesTestJSON-1495767864 tempest-VolumesTestJSON-1495767864-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/deca7668-25bf-4739-a166-5435908c0998" status: 200 len: 350 microversion: 2.1 time: 0.065804 Jun 24 09:43:11.801604 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 84/175] 10.222.0.65 () {58 vars in 1244 bytes} [Fri Jun 24 09:43:11 2022] GET /compute/v2.1/os-volumes/deca7668-25bf-4739-a166-5435908c0998 => generated 350 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:43:11.807593 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-695785f7-e1d0-4360-b30e-97ddf8544d97 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:11.808938 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-695785f7-e1d0-4360-b30e-97ddf8544d97 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:11.815440 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-695785f7-e1d0-4360-b30e-97ddf8544d97 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:11.815891 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-695785f7-e1d0-4360-b30e-97ddf8544d97 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:11.816671 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-695785f7-e1d0-4360-b30e-97ddf8544d97 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:11.817106 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-695785f7-e1d0-4360-b30e-97ddf8544d97 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:12.109767 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-695785f7-e1d0-4360-b30e-97ddf8544d97 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:12.119865 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-695785f7-e1d0-4360-b30e-97ddf8544d97 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 200 len: 1503 microversion: 2.1 time: 0.315987 Jun 24 09:43:12.131592 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 92/176] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:11 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 1503 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:43:12.464429 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-9aae71b0-7b60-4404-a1c2-ac9558b4b99a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:43:12.465859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-9aae71b0-7b60-4404-a1c2-ac9558b4b99a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:12.472452 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9aae71b0-7b60-4404-a1c2-ac9558b4b99a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:12.472990 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9aae71b0-7b60-4404-a1c2-ac9558b4b99a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:12.473827 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9aae71b0-7b60-4404-a1c2-ac9558b4b99a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:12.474326 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9aae71b0-7b60-4404-a1c2-ac9558b4b99a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:12.500405 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.objects.instance [None req-9aae71b0-7b60-4404-a1c2-ac9558b4b99a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lazy-loading 'flavor' on Instance uuid 2135f6c7-0718-46fa-94a8-f948e487e37f {{(pid=124338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:43:12.627695 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-f307e930-d70b-4de3-8cfc-f8f5f78926e6 req-e7d9eeb5-f542-471a-9593-9a65b21f4151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39bd42f5-35d7-4622-9ce8-36a4bcf28fed", "name": "network-vif-deleted", "tag": "cc05e753-e2f5-49ee-bcff-8be71968f994"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:43:12.644213 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-9aae71b0-7b60-4404-a1c2-ac9558b4b99a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "POST /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f/action" status: 200 len: 32 microversion: 2.1 time: 0.183193 Jun 24 09:43:12.644981 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 85/177] 10.222.0.65 () {60 vars in 1277 bytes} [Fri Jun 24 09:43:12 2022] POST /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f/action => generated 32 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 24 09:43:12.659120 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-f307e930-d70b-4de3-8cfc-f8f5f78926e6 req-e7d9eeb5-f542-471a-9593-9a65b21f4151 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:12.659377 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-0301f505-8f01-48b7-b087-92d6dd7cce06 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:12.660541 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-f307e930-d70b-4de3-8cfc-f8f5f78926e6 req-e7d9eeb5-f542-471a-9593-9a65b21f4151 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:12.663535 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-0301f505-8f01-48b7-b087-92d6dd7cce06 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:12.680335 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0301f505-8f01-48b7-b087-92d6dd7cce06 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:12.682686 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-f307e930-d70b-4de3-8cfc-f8f5f78926e6 req-e7d9eeb5-f542-471a-9593-9a65b21f4151 service nova] Creating event network-vif-deleted:cc05e753-e2f5-49ee-bcff-8be71968f994 for instance 39bd42f5-35d7-4622-9ce8-36a4bcf28fed on hv-cinder-80382 Jun 24 09:43:12.682922 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0301f505-8f01-48b7-b087-92d6dd7cce06 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:12.683944 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0301f505-8f01-48b7-b087-92d6dd7cce06 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:12.684381 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0301f505-8f01-48b7-b087-92d6dd7cce06 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:12.691274 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-f307e930-d70b-4de3-8cfc-f8f5f78926e6 req-e7d9eeb5-f542-471a-9593-9a65b21f4151 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067914 Jun 24 09:43:12.703243 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 93/178] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:43:12.889640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-0301f505-8f01-48b7-b087-92d6dd7cce06 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:12.899351 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-0301f505-8f01-48b7-b087-92d6dd7cce06 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1521 microversion: 2.1 time: 0.248535 Jun 24 09:43:12.900096 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 86/179] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:12 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:13.140288 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-240e4dfe-e9a9-4497-8731-747e9cf53932 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:13.140999 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-240e4dfe-e9a9-4497-8731-747e9cf53932 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:13.154107 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-240e4dfe-e9a9-4497-8731-747e9cf53932 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:13.154942 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-240e4dfe-e9a9-4497-8731-747e9cf53932 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:13.157605 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-240e4dfe-e9a9-4497-8731-747e9cf53932 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:13.158911 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-240e4dfe-e9a9-4497-8731-747e9cf53932 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:13.225050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-240e4dfe-e9a9-4497-8731-747e9cf53932 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:13.225698 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-240e4dfe-e9a9-4497-8731-747e9cf53932 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:13.226393 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.objects.instance [None req-240e4dfe-e9a9-4497-8731-747e9cf53932 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lazy-loading 'fault' on Instance uuid 39bd42f5-35d7-4622-9ce8-36a4bcf28fed {{(pid=124339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:43:13.342778 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-240e4dfe-e9a9-4497-8731-747e9cf53932 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:13.350702 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-240e4dfe-e9a9-4497-8731-747e9cf53932 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 200 len: 1303 microversion: 2.1 time: 0.217230 Jun 24 09:43:13.351324 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 94/180] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:13 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 1303 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:13.383670 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-4e966328-9313-410a-89ee-dfb1465186da tempest-VolumesTestJSON-1495767864 tempest-VolumesTestJSON-1495767864-project] Calling method '.version_select at 0x7fc6d4f0d670>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:13.452445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-4e966328-9313-410a-89ee-dfb1465186da tempest-VolumesTestJSON-1495767864 tempest-VolumesTestJSON-1495767864-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f3516db0-0970-4574-9e51-2cfd43063b43" status: 200 len: 350 microversion: 2.1 time: 0.074086 Jun 24 09:43:13.453580 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 87/181] 10.222.0.65 () {58 vars in 1244 bytes} [Fri Jun 24 09:43:13 2022] GET /compute/v2.1/os-volumes/f3516db0-0970-4574-9e51-2cfd43063b43 => generated 350 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:43:13.916564 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7dc0f298-1356-4977-9672-686d7ac582c8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:13.917376 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-7dc0f298-1356-4977-9672-686d7ac582c8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:13.919806 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:43:13.931765 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7dc0f298-1356-4977-9672-686d7ac582c8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:13.932301 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7dc0f298-1356-4977-9672-686d7ac582c8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:13.933208 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7dc0f298-1356-4977-9672-686d7ac582c8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:13.933707 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7dc0f298-1356-4977-9672-686d7ac582c8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:14.116535 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-7dc0f298-1356-4977-9672-686d7ac582c8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:14.125183 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-7dc0f298-1356-4977-9672-686d7ac582c8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1521 microversion: 2.1 time: 0.212791 Jun 24 09:43:14.125783 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 95/182] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:13 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:14.372211 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-0af7d812-20fc-4fc3-b3d2-aeeeca97ce15 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:14.373259 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-0af7d812-20fc-4fc3-b3d2-aeeeca97ce15 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 39bd42f5-35d7-4622-9ce8-36a4bcf28fed] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:14.379824 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0af7d812-20fc-4fc3-b3d2-aeeeca97ce15 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:14.380273 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0af7d812-20fc-4fc3-b3d2-aeeeca97ce15 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:14.381383 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0af7d812-20fc-4fc3-b3d2-aeeeca97ce15 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:14.381810 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0af7d812-20fc-4fc3-b3d2-aeeeca97ce15 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:14.396550 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.wsgi [None req-0af7d812-20fc-4fc3-b3d2-aeeeca97ce15 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] HTTP exception thrown: Instance 39bd42f5-35d7-4622-9ce8-36a4bcf28fed could not be found. Jun 24 09:43:14.402048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-0af7d812-20fc-4fc3-b3d2-aeeeca97ce15 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Request method failure captured: Jun 24 09:43:14.402048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed HTTP/1.1 Jun 24 09:43:14.402048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:43:14.402048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:43:14.402048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:43:14.402048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 0 Jun 24 09:43:14.402048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:43:14.402048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:43:14.402048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:43:14.402048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:43:14.402048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYcUCbfMbWpYGGYs-p-ddGbgpfZpxhMAaru7ay-DLsasV-YYyeQZ9_ZF5BrVtS4mzVsJrZZLTyhGVvyztwphfJnRWOL2wz9ClribuqMUhcRwcNq5gUV2WGQCMxv_Z-FveGX6bY4VJZajBE9i1oIrwvDIH67RW85-fOtaatUdf_NBIcI Jun 24 09:43:14.402048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:43:14.402048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:43:14.402048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:43:14.402048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:43:14.402048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:43:14.402048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:43:14.402048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: 6c5b285a04564d5d917a4566bec984b2 Jun 24 09:43:14.402048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-VolumesActionsTest-404609107 Jun 24 09:43:14.402048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:43:14.402048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:43:14.403516 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6c5b285a04564d5d917a4566bec984b2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6c5b285a04564d5d917a4566bec984b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6c5b285a04564d5d917a4566bec984b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6c5b285a04564d5d917a4566bec984b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:43:14.403516 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-VolumesActionsTest-404609107 Jun 24 09:43:14.403516 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: 6c5b285a04564d5d917a4566bec984b2 Jun 24 09:43:14.403516 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-VolumesActionsTest-404609107 Jun 24 09:43:14.403516 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-VolumesActionsTest-404609107-project Jun 24 09:43:14.403516 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:43:14.403516 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:43:14.403516 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: 1e4d2ec6d0014c99a818e1000869b38c Jun 24 09:43:14.403516 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-VolumesActionsTest-404609107-project Jun 24 09:43:14.403516 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: > Jun 24 09:43:14.403516 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Instance 39bd42f5-35d7-4622-9ce8-36a4bcf28fed could not be found. Jun 24 09:43:14.403516 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'id': '39bd42f5-35d7-4622-9ce8-36a4bcf28fed'} Jun 24 09:43:14.404185 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:43:14.404185 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:43:14.404185 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:43:14.404185 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:43:14.404185 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:43:14.404185 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:43:14.404185 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:43:14.404185 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:43:14.404185 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:43:14.404185 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:43:14.404185 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39bd42f5-35d7-4622-9ce8-36a4bcf28fed could not be found. Jun 24 09:43:14.404185 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:43:14.404185 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:43:14.404185 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:43:14.404185 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:43:14.404185 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:43:14.404185 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:43:14.404185 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:43:14.404185 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:43:14.404185 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:43:14.405287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:43:14.405287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:43:14.405287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:43:14.405287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:43:14.405287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:43:14.405287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:43:14.405287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:43:14.405287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39bd42f5-35d7-4622-9ce8-36a4bcf28fed could not be found. Jun 24 09:43:14.405287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:43:14.405287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:43:14.405287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:43:14.405287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:43:14.405287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:43:14.405287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:43:14.405287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:43:14.405287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:43:14.405287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39bd42f5-35d7-4622-9ce8-36a4bcf28fed could not be found. Jun 24 09:43:14.405287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:43:14.406271 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-0af7d812-20fc-4fc3-b3d2-aeeeca97ce15 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Returning 404 to user: Instance 39bd42f5-35d7-4622-9ce8-36a4bcf28fed could not be found. {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:43:14.406271 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-0af7d812-20fc-4fc3-b3d2-aeeeca97ce15 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed" status: 404 len: 111 microversion: 2.1 time: 0.035973 Jun 24 09:43:14.406271 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 88/183] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:14 2022] GET /compute/v2.1/servers/39bd42f5-35d7-4622-9ce8-36a4bcf28fed => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:43:14.505578 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-709cbd4d-bb6f-4c15-9ca2-7c21779ee781 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-327572530", "imageRef": "844ad823-18a2-4abc-813c-2d1825141591", "flavorRef": "452", "networks": [{"uuid": "011dd503-a916-4a1e-aafe-2bca320c6dcb"}]}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:43:14.557728 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.network.neutron [None req-709cbd4d-bb6f-4c15-9ca2-7c21779ee781 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] validate_networks() for [('011dd503-a916-4a1e-aafe-2bca320c6dcb', None, None, None, None, None)] {{(pid=124339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:43:14.840084 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-d16e3618-22cc-4442-9c73-31cd69b463e4 tempest-VolumesTestJSON-1495767864 tempest-VolumesTestJSON-1495767864-project] Calling method '.version_select at 0x7fc6d4d32f70>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:14.890927 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-d16e3618-22cc-4442-9c73-31cd69b463e4 tempest-VolumesTestJSON-1495767864 tempest-VolumesTestJSON-1495767864-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d00c2a00-8df8-4f88-a8af-1c823da9717a" status: 200 len: 351 microversion: 2.1 time: 0.054881 Jun 24 09:43:14.891615 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 89/184] 10.222.0.65 () {58 vars in 1244 bytes} [Fri Jun 24 09:43:14 2022] GET /compute/v2.1/os-volumes/d00c2a00-8df8-4f88-a8af-1c823da9717a => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:43:14.902955 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-f1ac5aa0-ecb2-468a-9ee7-327e86bbfc1e tempest-VolumesTestJSON-1495767864 tempest-VolumesTestJSON-1495767864-project] Calling method '.version_select at 0x7fc6d4d54670>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:14.941561 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-709cbd4d-bb6f-4c15-9ca2-7c21779ee781 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Flavor limits 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:43:14.942100 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-709cbd4d-bb6f-4c15-9ca2-7c21779ee781 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Image limits 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:43:14.942710 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-709cbd4d-bb6f-4c15-9ca2-7c21779ee781 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Flavor pref 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:43:14.943251 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-709cbd4d-bb6f-4c15-9ca2-7c21779ee781 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Image pref 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:43:14.943764 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-709cbd4d-bb6f-4c15-9ca2-7c21779ee781 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:43:14.954673 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-709cbd4d-bb6f-4c15-9ca2-7c21779ee781 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:14.955427 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-709cbd4d-bb6f-4c15-9ca2-7c21779ee781 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:14.956550 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-709cbd4d-bb6f-4c15-9ca2-7c21779ee781 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:14.957197 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-709cbd4d-bb6f-4c15-9ca2-7c21779ee781 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:14.978206 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-709cbd4d-bb6f-4c15-9ca2-7c21779ee781 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Getting quotas for project 6c5b285a04564d5d917a4566bec984b2. Resources: {'cores', 'ram', 'instances'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:43:14.985018 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-709cbd4d-bb6f-4c15-9ca2-7c21779ee781 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Getting quotas for user 1e4d2ec6d0014c99a818e1000869b38c and project 6c5b285a04564d5d917a4566bec984b2. Resources: {'cores', 'ram', 'instances'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:43:14.998265 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-709cbd4d-bb6f-4c15-9ca2-7c21779ee781 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Going to run 1 instances... {{(pid=124339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:43:15.001884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-709cbd4d-bb6f-4c15-9ca2-7c21779ee781 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='844ad823-18a2-4abc-813c-2d1825141591',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:43:15.003099 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-f1ac5aa0-ecb2-468a-9ee7-327e86bbfc1e tempest-VolumesTestJSON-1495767864 tempest-VolumesTestJSON-1495767864-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.104365 Jun 24 09:43:15.003739 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 90/185] 10.222.0.65 () {58 vars in 1133 bytes} [Fri Jun 24 09:43:14 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:15.016286 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-09b546b9-43db-4133-99bf-177464da4ada tempest-VolumesTestJSON-1495767864 tempest-VolumesTestJSON-1495767864-project] Calling method '.version_select at 0x7fc6d5830550>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:15.060330 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-709cbd4d-bb6f-4c15-9ca2-7c21779ee781 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558519 Jun 24 09:43:15.062946 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 96/186] 10.222.0.65 () {60 vars in 1146 bytes} [Fri Jun 24 09:43:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 09:43:15.067191 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-ef92ef5e-6fd7-4486-9949-725c7e20862d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1139672740", "imageRef": "844ad823-18a2-4abc-813c-2d1825141591", "flavorRef": "452", "networks": [{"uuid": "c876540d-f69d-4345-8da3-6262b1921560"}]}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:43:15.107212 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-09b546b9-43db-4133-99bf-177464da4ada tempest-VolumesTestJSON-1495767864 tempest-VolumesTestJSON-1495767864-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.094542 Jun 24 09:43:15.107788 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 91/187] 10.222.0.65 () {58 vars in 1148 bytes} [Fri Jun 24 09:43:15 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:43:15.114398 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-764a5260-b7e2-4140-babb-5c03960e107c tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:15.116225 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-764a5260-b7e2-4140-babb-5c03960e107c tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:15.145087 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.network.neutron [None req-ef92ef5e-6fd7-4486-9949-725c7e20862d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] validate_networks() for [('c876540d-f69d-4345-8da3-6262b1921560', None, None, None, None, None)] {{(pid=124339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:43:15.172523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-764a5260-b7e2-4140-babb-5c03960e107c tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:15.180704 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-764a5260-b7e2-4140-babb-5c03960e107c tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846" status: 200 len: 1213 microversion: 2.1 time: 0.071840 Jun 24 09:43:15.181275 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 92/188] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:15 2022] GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846 => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:15.188203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-1144f647-0d97-45ea-bcaa-0f84a4866473 tempest-VolumesTestJSON-1495767864 tempest-VolumesTestJSON-1495767864-project] Calling method '.version_select at 0x7fc6d4d54280>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:15.275531 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-1144f647-0d97-45ea-bcaa-0f84a4866473 tempest-VolumesTestJSON-1495767864 tempest-VolumesTestJSON-1495767864-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.092704 Jun 24 09:43:15.276440 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 93/189] 10.222.0.65 () {58 vars in 1133 bytes} [Fri Jun 24 09:43:15 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:15.281828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-dd05dfeb-c132-4bec-be27-884a30fc14f7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:15.282726 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-dd05dfeb-c132-4bec-be27-884a30fc14f7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:15.289519 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-dd05dfeb-c132-4bec-be27-884a30fc14f7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:15.289955 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-dd05dfeb-c132-4bec-be27-884a30fc14f7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:15.290885 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-dd05dfeb-c132-4bec-be27-884a30fc14f7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:15.291362 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-dd05dfeb-c132-4bec-be27-884a30fc14f7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:15.296774 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:43:15.523427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-dd05dfeb-c132-4bec-be27-884a30fc14f7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:15.531371 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-dd05dfeb-c132-4bec-be27-884a30fc14f7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1521 microversion: 2.1 time: 0.253169 Jun 24 09:43:15.531944 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 94/190] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:15 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:15.536872 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-52a40a55-740e-4acc-be37-b1b98bba9a94 tempest-VolumesTestJSON-1495767864 tempest-VolumesTestJSON-1495767864-project] Calling method '.version_select at 0x7fc6d4d549d0>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:15.621882 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-52a40a55-740e-4acc-be37-b1b98bba9a94 tempest-VolumesTestJSON-1495767864 tempest-VolumesTestJSON-1495767864-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087525 Jun 24 09:43:15.622694 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 95/191] 10.222.0.65 () {58 vars in 1166 bytes} [Fri Jun 24 09:43:15 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:43:15.635053 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-ef92ef5e-6fd7-4486-9949-725c7e20862d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Flavor limits 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:43:15.635776 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-ef92ef5e-6fd7-4486-9949-725c7e20862d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Image limits 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:43:15.637048 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-ef92ef5e-6fd7-4486-9949-725c7e20862d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Flavor pref 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:43:15.637464 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-ef92ef5e-6fd7-4486-9949-725c7e20862d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Image pref 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:43:15.637872 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-ef92ef5e-6fd7-4486-9949-725c7e20862d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:43:15.638766 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-81e16439-c00f-48e6-9f6a-4a5e064d4c84 tempest-VolumesTestJSON-1495767864 tempest-VolumesTestJSON-1495767864-project] Calling method '.version_select at 0x7fc6d5808b80>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:15.647132 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ef92ef5e-6fd7-4486-9949-725c7e20862d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:15.647598 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ef92ef5e-6fd7-4486-9949-725c7e20862d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:15.649226 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ef92ef5e-6fd7-4486-9949-725c7e20862d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:15.649676 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ef92ef5e-6fd7-4486-9949-725c7e20862d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:15.668549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-ef92ef5e-6fd7-4486-9949-725c7e20862d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Getting quotas for project 2b043de82f1b43f78e3b92d375111d91. Resources: {'cores', 'ram', 'instances'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:43:15.673807 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-ef92ef5e-6fd7-4486-9949-725c7e20862d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Getting quotas for user 7f8df9faa4dd4eeeb724e891cdb55616 and project 2b043de82f1b43f78e3b92d375111d91. Resources: {'cores', 'ram', 'instances'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:43:15.685583 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-ef92ef5e-6fd7-4486-9949-725c7e20862d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Going to run 1 instances... {{(pid=124339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:43:15.687757 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-ef92ef5e-6fd7-4486-9949-725c7e20862d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='844ad823-18a2-4abc-813c-2d1825141591',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:43:15.720402 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-81e16439-c00f-48e6-9f6a-4a5e064d4c84 tempest-VolumesTestJSON-1495767864 tempest-VolumesTestJSON-1495767864-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085664 Jun 24 09:43:15.720990 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 96/192] 10.222.0.65 () {58 vars in 1169 bytes} [Fri Jun 24 09:43:15 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:43:15.734569 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-4462fe82-7dc8-4ac0-a719-51f4c653e801 tempest-VolumesTestJSON-1495767864 tempest-VolumesTestJSON-1495767864-project] Calling method '.version_select at 0x7fc6d4d5db80>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:15.739014 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-ef92ef5e-6fd7-4486-9949-725c7e20862d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676037 Jun 24 09:43:15.744352 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 97/193] 10.222.0.65 () {60 vars in 1146 bytes} [Fri Jun 24 09:43:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 09:43:15.750559 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-887b3e52-3522-4a7f-a87e-7724944b0b36 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:15.751236 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-887b3e52-3522-4a7f-a87e-7724944b0b36 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:15.828455 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-887b3e52-3522-4a7f-a87e-7724944b0b36 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:15.836930 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-887b3e52-3522-4a7f-a87e-7724944b0b36 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1219 microversion: 2.1 time: 0.090315 Jun 24 09:43:15.837819 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 98/194] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:15 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:43:16.002428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-4462fe82-7dc8-4ac0-a719-51f4c653e801 tempest-VolumesTestJSON-1495767864 tempest-VolumesTestJSON-1495767864-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.273192 Jun 24 09:43:16.002999 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 97/195] 10.222.0.65 () {58 vars in 1154 bytes} [Fri Jun 24 09:43:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:43:16.015626 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-6f2a2963-492d-42ad-9bf1-7256ecb8ca90 tempest-VolumesTestJSON-1495767864 tempest-VolumesTestJSON-1495767864-project] Calling method '.version_select at 0x7fc6d4595160>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:16.123894 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-6f2a2963-492d-42ad-9bf1-7256ecb8ca90 tempest-VolumesTestJSON-1495767864 tempest-VolumesTestJSON-1495767864-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.113524 Jun 24 09:43:16.124469 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 99/196] 10.222.0.65 () {58 vars in 1187 bytes} [Fri Jun 24 09:43:16 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:43:16.137653 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-2ad18eb1-217a-40af-87df-fc508ead30a7 tempest-VolumesTestJSON-1495767864 tempest-VolumesTestJSON-1495767864-project] Calling method '.version_select at 0x7fc6d4e33430>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:16.198725 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4bb5c910-be80-4d0c-896c-759a0fedc715 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:16.199532 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-4bb5c910-be80-4d0c-896c-759a0fedc715 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:16.211870 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4bb5c910-be80-4d0c-896c-759a0fedc715 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:16.212590 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4bb5c910-be80-4d0c-896c-759a0fedc715 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:16.213686 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4bb5c910-be80-4d0c-896c-759a0fedc715 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:16.214292 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4bb5c910-be80-4d0c-896c-759a0fedc715 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:16.276178 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-2ad18eb1-217a-40af-87df-fc508ead30a7 tempest-VolumesTestJSON-1495767864 tempest-VolumesTestJSON-1495767864-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.142666 Jun 24 09:43:16.287853 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 98/197] 10.222.0.65 () {58 vars in 1154 bytes} [Fri Jun 24 09:43:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:16.360730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4bb5c910-be80-4d0c-896c-759a0fedc715 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:16.377775 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-4bb5c910-be80-4d0c-896c-759a0fedc715 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846" status: 200 len: 1283 microversion: 2.1 time: 0.183677 Jun 24 09:43:16.378393 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 100/198] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:16 2022] GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846 => generated 1283 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:16.547830 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-83f9debd-13e7-4012-8667-0bc6a188e769 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:16.548447 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-83f9debd-13e7-4012-8667-0bc6a188e769 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:16.558254 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-83f9debd-13e7-4012-8667-0bc6a188e769 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:16.558673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-83f9debd-13e7-4012-8667-0bc6a188e769 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:16.559493 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-83f9debd-13e7-4012-8667-0bc6a188e769 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:16.560005 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-83f9debd-13e7-4012-8667-0bc6a188e769 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:16.747034 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-83f9debd-13e7-4012-8667-0bc6a188e769 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:16.755134 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-83f9debd-13e7-4012-8667-0bc6a188e769 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1521 microversion: 2.1 time: 0.211192 Jun 24 09:43:16.755708 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 99/199] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:16 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:16.856202 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-6da62072-6219-4721-ae7a-c209976af6fb tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:16.856810 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-6da62072-6219-4721-ae7a-c209976af6fb tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:16.863815 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6da62072-6219-4721-ae7a-c209976af6fb tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:16.864255 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6da62072-6219-4721-ae7a-c209976af6fb tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:16.865025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6da62072-6219-4721-ae7a-c209976af6fb tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:16.865608 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6da62072-6219-4721-ae7a-c209976af6fb tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:16.958593 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6da62072-6219-4721-ae7a-c209976af6fb tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:16.966964 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-6da62072-6219-4721-ae7a-c209976af6fb tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1271 microversion: 2.1 time: 0.115445 Jun 24 09:43:16.967811 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 101/200] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:16 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1271 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:17.396477 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-26a595a7-29a0-4288-9985-0b5f4e84eeed tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:17.403411 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-26a595a7-29a0-4288-9985-0b5f4e84eeed tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:17.410456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-26a595a7-29a0-4288-9985-0b5f4e84eeed tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:17.411214 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-26a595a7-29a0-4288-9985-0b5f4e84eeed tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:17.412061 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-26a595a7-29a0-4288-9985-0b5f4e84eeed tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:17.412700 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-26a595a7-29a0-4288-9985-0b5f4e84eeed tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:17.656554 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-26a595a7-29a0-4288-9985-0b5f4e84eeed tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:17.672163 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-26a595a7-29a0-4288-9985-0b5f4e84eeed tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846" status: 200 len: 1313 microversion: 2.1 time: 0.279673 Jun 24 09:43:17.673020 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 100/201] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:17 2022] GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:17.772705 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e664ffce-fc6f-450a-af51-c8ad036482e1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:17.773649 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e664ffce-fc6f-450a-af51-c8ad036482e1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:17.781006 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e664ffce-fc6f-450a-af51-c8ad036482e1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:17.781732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e664ffce-fc6f-450a-af51-c8ad036482e1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:17.783001 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e664ffce-fc6f-450a-af51-c8ad036482e1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:17.783669 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e664ffce-fc6f-450a-af51-c8ad036482e1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:17.829803 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-96a8a5d3-d82c-4630-85bb-001bd3603f1f req-0cc1ea38-0a8b-4879-b8a4-ed270f3aa751 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9293ecc8-771f-46d1-b766-87dba541e846", "tag": "de904479-c699-411b-bcd7-6cca91e2d75f"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:43:17.862706 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-96a8a5d3-d82c-4630-85bb-001bd3603f1f req-0cc1ea38-0a8b-4879-b8a4-ed270f3aa751 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:17.864131 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-96a8a5d3-d82c-4630-85bb-001bd3603f1f req-0cc1ea38-0a8b-4879-b8a4-ed270f3aa751 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:17.878475 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-96a8a5d3-d82c-4630-85bb-001bd3603f1f req-0cc1ea38-0a8b-4879-b8a4-ed270f3aa751 service nova] Creating event network-changed:de904479-c699-411b-bcd7-6cca91e2d75f for instance 9293ecc8-771f-46d1-b766-87dba541e846 on hv-cinder-80382 Jun 24 09:43:17.885497 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-96a8a5d3-d82c-4630-85bb-001bd3603f1f req-0cc1ea38-0a8b-4879-b8a4-ed270f3aa751 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059651 Jun 24 09:43:17.886429 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 101/202] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:43:17.985811 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-86aa39df-0631-4ff6-a53d-a6cf9e4e6a4e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:17.986460 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-86aa39df-0631-4ff6-a53d-a6cf9e4e6a4e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:17.993139 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-86aa39df-0631-4ff6-a53d-a6cf9e4e6a4e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:17.993728 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-86aa39df-0631-4ff6-a53d-a6cf9e4e6a4e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:17.994487 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-86aa39df-0631-4ff6-a53d-a6cf9e4e6a4e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:17.994923 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-86aa39df-0631-4ff6-a53d-a6cf9e4e6a4e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:18.004531 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e664ffce-fc6f-450a-af51-c8ad036482e1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:18.013681 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e664ffce-fc6f-450a-af51-c8ad036482e1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1521 microversion: 2.1 time: 0.244784 Jun 24 09:43:18.023597 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 102/203] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:17 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:18.225294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-86aa39df-0631-4ff6-a53d-a6cf9e4e6a4e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:18.236241 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-86aa39df-0631-4ff6-a53d-a6cf9e4e6a4e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1319 microversion: 2.1 time: 0.254421 Jun 24 09:43:18.237113 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 102/204] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:17 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:18.677256 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-636aa0ac-24db-4272-94c9-692cb63b174c req-3b68ffaa-4b3d-4bb7-857d-bdba5dcf8035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce0dadb5-652d-42b9-90aa-461f74d68dca", "tag": "572f669e-9d6a-459f-b60d-673ffe96ade9"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:43:18.687951 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-636aa0ac-24db-4272-94c9-692cb63b174c req-3b68ffaa-4b3d-4bb7-857d-bdba5dcf8035 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:18.688630 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-636aa0ac-24db-4272-94c9-692cb63b174c req-3b68ffaa-4b3d-4bb7-857d-bdba5dcf8035 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:18.690726 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-b6ce2b11-4fe9-4e1a-983b-eaf75f77b071 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:18.693934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-b6ce2b11-4fe9-4e1a-983b-eaf75f77b071 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:18.705958 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b6ce2b11-4fe9-4e1a-983b-eaf75f77b071 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:18.706408 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b6ce2b11-4fe9-4e1a-983b-eaf75f77b071 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:18.707688 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=100 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:43:18.709618 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-636aa0ac-24db-4272-94c9-692cb63b174c req-3b68ffaa-4b3d-4bb7-857d-bdba5dcf8035 service nova] Creating event network-changed:572f669e-9d6a-459f-b60d-673ffe96ade9 for instance ce0dadb5-652d-42b9-90aa-461f74d68dca on hv-cinder-80382 Jun 24 09:43:18.710073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b6ce2b11-4fe9-4e1a-983b-eaf75f77b071 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:18.710543 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b6ce2b11-4fe9-4e1a-983b-eaf75f77b071 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:18.724903 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-636aa0ac-24db-4272-94c9-692cb63b174c req-3b68ffaa-4b3d-4bb7-857d-bdba5dcf8035 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050965 Jun 24 09:43:18.726350 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 103/205] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:43:18.870397 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-b6ce2b11-4fe9-4e1a-983b-eaf75f77b071 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:18.878600 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-b6ce2b11-4fe9-4e1a-983b-eaf75f77b071 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846" status: 200 len: 1313 microversion: 2.1 time: 0.191797 Jun 24 09:43:18.879205 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 103/206] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:18 2022] GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:19.032161 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e378f1fd-2b8c-48d9-be07-e676efbcd3b8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:19.032816 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e378f1fd-2b8c-48d9-be07-e676efbcd3b8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:19.039799 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e378f1fd-2b8c-48d9-be07-e676efbcd3b8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:19.040247 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e378f1fd-2b8c-48d9-be07-e676efbcd3b8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:19.041019 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e378f1fd-2b8c-48d9-be07-e676efbcd3b8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:19.041454 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e378f1fd-2b8c-48d9-be07-e676efbcd3b8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:19.185429 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e378f1fd-2b8c-48d9-be07-e676efbcd3b8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:19.193120 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e378f1fd-2b8c-48d9-be07-e676efbcd3b8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1521 microversion: 2.1 time: 0.165364 Jun 24 09:43:19.193699 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 104/207] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:19 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:19.253455 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-c713d506-8744-4f88-b8ea-bc6439e87470 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:19.254065 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-c713d506-8744-4f88-b8ea-bc6439e87470 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:19.260353 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c713d506-8744-4f88-b8ea-bc6439e87470 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:19.260815 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c713d506-8744-4f88-b8ea-bc6439e87470 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:19.261961 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c713d506-8744-4f88-b8ea-bc6439e87470 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:19.262390 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c713d506-8744-4f88-b8ea-bc6439e87470 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:19.394277 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-c713d506-8744-4f88-b8ea-bc6439e87470 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:19.405451 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-c713d506-8744-4f88-b8ea-bc6439e87470 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1319 microversion: 2.1 time: 0.155605 Jun 24 09:43:19.406230 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 104/208] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:19 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:19.896925 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-6cf829d8-6984-45e0-9564-0ca18f15040a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:19.897808 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-6cf829d8-6984-45e0-9564-0ca18f15040a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:19.910665 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6cf829d8-6984-45e0-9564-0ca18f15040a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:19.913833 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6cf829d8-6984-45e0-9564-0ca18f15040a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:19.914842 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6cf829d8-6984-45e0-9564-0ca18f15040a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:19.915459 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6cf829d8-6984-45e0-9564-0ca18f15040a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:20.204848 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6cf829d8-6984-45e0-9564-0ca18f15040a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:20.211975 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-55828776-ecda-4b89-a1dd-6dfbdb42b408 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:20.212976 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-6cf829d8-6984-45e0-9564-0ca18f15040a tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846" status: 200 len: 1313 microversion: 2.1 time: 0.320865 Jun 24 09:43:20.213646 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-55828776-ecda-4b89-a1dd-6dfbdb42b408 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:20.221959 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-55828776-ecda-4b89-a1dd-6dfbdb42b408 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:20.222517 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-55828776-ecda-4b89-a1dd-6dfbdb42b408 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:20.223435 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-55828776-ecda-4b89-a1dd-6dfbdb42b408 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:20.223575 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 105/209] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:19 2022] GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846 => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:20.224161 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-55828776-ecda-4b89-a1dd-6dfbdb42b408 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:20.401173 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-55828776-ecda-4b89-a1dd-6dfbdb42b408 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:20.409145 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-55828776-ecda-4b89-a1dd-6dfbdb42b408 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1521 microversion: 2.1 time: 0.202834 Jun 24 09:43:20.409730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 105/210] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:20 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:43:20.422204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-15e5c5b8-3c56-4f46-9022-b6a4554c418a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:20.422821 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-15e5c5b8-3c56-4f46-9022-b6a4554c418a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:20.429302 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-15e5c5b8-3c56-4f46-9022-b6a4554c418a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:20.429754 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-15e5c5b8-3c56-4f46-9022-b6a4554c418a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:20.430521 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-15e5c5b8-3c56-4f46-9022-b6a4554c418a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:20.430965 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-15e5c5b8-3c56-4f46-9022-b6a4554c418a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:20.570255 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-15e5c5b8-3c56-4f46-9022-b6a4554c418a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:20.578414 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-15e5c5b8-3c56-4f46-9022-b6a4554c418a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1319 microversion: 2.1 time: 0.160105 Jun 24 09:43:20.579108 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 106/211] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:20 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:21.229953 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-68e5d87a-19c8-412e-a18e-f6aadf72f282 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:21.231322 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-68e5d87a-19c8-412e-a18e-f6aadf72f282 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:21.238614 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-68e5d87a-19c8-412e-a18e-f6aadf72f282 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:21.239166 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-68e5d87a-19c8-412e-a18e-f6aadf72f282 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:21.240553 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-68e5d87a-19c8-412e-a18e-f6aadf72f282 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:21.241158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-68e5d87a-19c8-412e-a18e-f6aadf72f282 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:21.396494 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-68e5d87a-19c8-412e-a18e-f6aadf72f282 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:21.405055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-68e5d87a-19c8-412e-a18e-f6aadf72f282 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846" status: 200 len: 1313 microversion: 2.1 time: 0.179127 Jun 24 09:43:21.405644 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 106/212] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:21 2022] GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:21.428069 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-2a662859-ea7f-4058-8fdc-8be57bb12884 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:21.429050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-2a662859-ea7f-4058-8fdc-8be57bb12884 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:21.437979 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2a662859-ea7f-4058-8fdc-8be57bb12884 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:21.438429 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2a662859-ea7f-4058-8fdc-8be57bb12884 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:21.439246 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2a662859-ea7f-4058-8fdc-8be57bb12884 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:21.439779 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2a662859-ea7f-4058-8fdc-8be57bb12884 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:21.595517 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-6173513a-89c7-43ce-b093-c238dcdac1d3 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:21.596118 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-6173513a-89c7-43ce-b093-c238dcdac1d3 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:21.600831 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-2a662859-ea7f-4058-8fdc-8be57bb12884 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:21.603060 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6173513a-89c7-43ce-b093-c238dcdac1d3 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:21.603722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6173513a-89c7-43ce-b093-c238dcdac1d3 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:21.604861 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6173513a-89c7-43ce-b093-c238dcdac1d3 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:21.606088 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6173513a-89c7-43ce-b093-c238dcdac1d3 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:21.609897 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-2a662859-ea7f-4058-8fdc-8be57bb12884 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1521 microversion: 2.1 time: 0.187719 Jun 24 09:43:21.617694 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 107/213] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:21 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:21.758722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-6173513a-89c7-43ce-b093-c238dcdac1d3 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:21.767001 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-6173513a-89c7-43ce-b093-c238dcdac1d3 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1319 microversion: 2.1 time: 0.175280 Jun 24 09:43:21.768178 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 107/214] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:21 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:22.422110 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a93b5c33-20d7-4fdc-b6d5-5f804180a5d4 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:22.422720 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-a93b5c33-20d7-4fdc-b6d5-5f804180a5d4 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:22.429195 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a93b5c33-20d7-4fdc-b6d5-5f804180a5d4 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:22.429854 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a93b5c33-20d7-4fdc-b6d5-5f804180a5d4 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:22.430450 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a93b5c33-20d7-4fdc-b6d5-5f804180a5d4 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:22.430879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a93b5c33-20d7-4fdc-b6d5-5f804180a5d4 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:22.628426 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-5f3c1c38-80da-49e1-8123-8aedbbf9d27b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:22.629002 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-5f3c1c38-80da-49e1-8123-8aedbbf9d27b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:22.635731 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5f3c1c38-80da-49e1-8123-8aedbbf9d27b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:22.636227 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5f3c1c38-80da-49e1-8123-8aedbbf9d27b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:22.637181 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5f3c1c38-80da-49e1-8123-8aedbbf9d27b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:22.637621 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5f3c1c38-80da-49e1-8123-8aedbbf9d27b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:22.817924 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-a93b5c33-20d7-4fdc-b6d5-5f804180a5d4 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:22.825867 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-a93b5c33-20d7-4fdc-b6d5-5f804180a5d4 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846" status: 200 len: 1313 microversion: 2.1 time: 0.407655 Jun 24 09:43:22.826418 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 108/215] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:22 2022] GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846 => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:22.830920 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-959ea21a-2781-40f4-a269-fd1e262b89d6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:22.831489 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-959ea21a-2781-40f4-a269-fd1e262b89d6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:22.837740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-959ea21a-2781-40f4-a269-fd1e262b89d6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:22.838179 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-959ea21a-2781-40f4-a269-fd1e262b89d6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:22.838937 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-959ea21a-2781-40f4-a269-fd1e262b89d6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:22.839561 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-959ea21a-2781-40f4-a269-fd1e262b89d6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:22.863755 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-5f3c1c38-80da-49e1-8123-8aedbbf9d27b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:22.871361 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-5f3c1c38-80da-49e1-8123-8aedbbf9d27b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1521 microversion: 2.1 time: 0.247641 Jun 24 09:43:22.871961 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 108/216] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:22 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:22.974671 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-959ea21a-2781-40f4-a269-fd1e262b89d6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:22.983110 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-959ea21a-2781-40f4-a269-fd1e262b89d6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1319 microversion: 2.1 time: 0.155694 Jun 24 09:43:22.983713 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 109/217] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:22 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:23.845298 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-8532cfc3-e48d-48d6-bfa1-8b2167c410ea tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:23.845941 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-8532cfc3-e48d-48d6-bfa1-8b2167c410ea tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:23.854945 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8532cfc3-e48d-48d6-bfa1-8b2167c410ea tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:23.855839 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8532cfc3-e48d-48d6-bfa1-8b2167c410ea tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:23.856860 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8532cfc3-e48d-48d6-bfa1-8b2167c410ea tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:23.857098 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8532cfc3-e48d-48d6-bfa1-8b2167c410ea tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:23.888882 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-cad0b930-6b26-4ad4-b57a-fbaacaa0b4f7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:23.889427 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-cad0b930-6b26-4ad4-b57a-fbaacaa0b4f7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:23.895998 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-cad0b930-6b26-4ad4-b57a-fbaacaa0b4f7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:23.896446 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-cad0b930-6b26-4ad4-b57a-fbaacaa0b4f7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:23.897415 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-cad0b930-6b26-4ad4-b57a-fbaacaa0b4f7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:23.897841 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-cad0b930-6b26-4ad4-b57a-fbaacaa0b4f7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:24.044761 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-8532cfc3-e48d-48d6-bfa1-8b2167c410ea tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:24.053266 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-8532cfc3-e48d-48d6-bfa1-8b2167c410ea tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846" status: 200 len: 1313 microversion: 2.1 time: 0.213699 Jun 24 09:43:24.053866 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 109/218] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:23 2022] GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:24.058394 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-991d3e28-bcc2-43d0-a397-70d90fd3a595 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:24.059164 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-991d3e28-bcc2-43d0-a397-70d90fd3a595 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:24.065439 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-991d3e28-bcc2-43d0-a397-70d90fd3a595 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:24.065890 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-991d3e28-bcc2-43d0-a397-70d90fd3a595 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:24.066652 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-991d3e28-bcc2-43d0-a397-70d90fd3a595 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:24.067143 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-991d3e28-bcc2-43d0-a397-70d90fd3a595 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:24.069316 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-cad0b930-6b26-4ad4-b57a-fbaacaa0b4f7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:24.077279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-cad0b930-6b26-4ad4-b57a-fbaacaa0b4f7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1521 microversion: 2.1 time: 0.192834 Jun 24 09:43:24.077862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 110/219] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:23 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:43:24.204587 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-991d3e28-bcc2-43d0-a397-70d90fd3a595 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:24.212620 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-991d3e28-bcc2-43d0-a397-70d90fd3a595 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1319 microversion: 2.1 time: 0.157647 Jun 24 09:43:24.213543 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 110/220] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:24 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:25.069552 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-63dbf4e5-a009-4848-aec1-e699de8bf7e2 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:25.070268 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-63dbf4e5-a009-4848-aec1-e699de8bf7e2 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:25.076544 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-63dbf4e5-a009-4848-aec1-e699de8bf7e2 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:25.080905 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-63dbf4e5-a009-4848-aec1-e699de8bf7e2 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:25.080905 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-63dbf4e5-a009-4848-aec1-e699de8bf7e2 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:25.080905 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-63dbf4e5-a009-4848-aec1-e699de8bf7e2 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:25.095395 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-61aaa48e-869d-4950-a762-7ebbb34d6d04 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:25.096142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-61aaa48e-869d-4950-a762-7ebbb34d6d04 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:25.102868 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-61aaa48e-869d-4950-a762-7ebbb34d6d04 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:25.103383 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-61aaa48e-869d-4950-a762-7ebbb34d6d04 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:25.104126 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-61aaa48e-869d-4950-a762-7ebbb34d6d04 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:25.104561 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-61aaa48e-869d-4950-a762-7ebbb34d6d04 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:25.178327 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=2 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:43:25.265636 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-63dbf4e5-a009-4848-aec1-e699de8bf7e2 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:25.273523 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-63dbf4e5-a009-4848-aec1-e699de8bf7e2 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846" status: 200 len: 1313 microversion: 2.1 time: 0.207722 Jun 24 09:43:25.283270 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 111/221] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:25 2022] GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:25.283270 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-30651a7b-1484-4b10-8687-7d41b69b4907 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:25.283270 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-30651a7b-1484-4b10-8687-7d41b69b4907 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:25.285862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-30651a7b-1484-4b10-8687-7d41b69b4907 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:25.286318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-30651a7b-1484-4b10-8687-7d41b69b4907 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:25.287116 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-30651a7b-1484-4b10-8687-7d41b69b4907 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:25.287549 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-61aaa48e-869d-4950-a762-7ebbb34d6d04 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:25.287661 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-30651a7b-1484-4b10-8687-7d41b69b4907 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:25.296345 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-61aaa48e-869d-4950-a762-7ebbb34d6d04 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1521 microversion: 2.1 time: 0.205637 Jun 24 09:43:25.296906 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 111/222] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:25 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:25.425082 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-30651a7b-1484-4b10-8687-7d41b69b4907 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:25.436583 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-30651a7b-1484-4b10-8687-7d41b69b4907 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1319 microversion: 2.1 time: 0.161237 Jun 24 09:43:25.437387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 112/223] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:25 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:26.289938 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-23875e1c-3565-4d74-a23d-007616950a5d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:26.290552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-23875e1c-3565-4d74-a23d-007616950a5d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:26.297278 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-23875e1c-3565-4d74-a23d-007616950a5d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:26.297728 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-23875e1c-3565-4d74-a23d-007616950a5d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:26.298537 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-23875e1c-3565-4d74-a23d-007616950a5d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:26.298971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-23875e1c-3565-4d74-a23d-007616950a5d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:26.313916 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-40455160-851b-48df-85a9-c5a7509d1b58 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:26.315243 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-40455160-851b-48df-85a9-c5a7509d1b58 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:26.317360 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=4 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:43:26.318420 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=14 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:43:26.323991 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-40455160-851b-48df-85a9-c5a7509d1b58 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:26.324640 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-40455160-851b-48df-85a9-c5a7509d1b58 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:26.325698 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-40455160-851b-48df-85a9-c5a7509d1b58 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:26.326223 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-40455160-851b-48df-85a9-c5a7509d1b58 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:26.501228 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-23875e1c-3565-4d74-a23d-007616950a5d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:26.504980 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-40455160-851b-48df-85a9-c5a7509d1b58 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:26.509210 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-23875e1c-3565-4d74-a23d-007616950a5d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846" status: 200 len: 1313 microversion: 2.1 time: 0.223132 Jun 24 09:43:26.510137 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 112/224] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:26 2022] GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:26.514659 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ce5d2220-795d-45b5-8e0d-c92ce7fa71ac tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:26.515287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ce5d2220-795d-45b5-8e0d-c92ce7fa71ac tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:26.521648 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ce5d2220-795d-45b5-8e0d-c92ce7fa71ac tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:26.522092 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ce5d2220-795d-45b5-8e0d-c92ce7fa71ac tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:26.522853 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ce5d2220-795d-45b5-8e0d-c92ce7fa71ac tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:26.523159 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-40455160-851b-48df-85a9-c5a7509d1b58 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1521 microversion: 2.1 time: 0.212923 Jun 24 09:43:26.523340 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ce5d2220-795d-45b5-8e0d-c92ce7fa71ac tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:26.524026 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 113/225] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:26 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:26.660095 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ce5d2220-795d-45b5-8e0d-c92ce7fa71ac tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:26.667795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ce5d2220-795d-45b5-8e0d-c92ce7fa71ac tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1319 microversion: 2.1 time: 0.156618 Jun 24 09:43:26.668364 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 113/226] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:26 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:27.055563 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-204153b9-9caf-40cf-be00-edeed404eb19 req-5c954dea-7870-4768-8e77-f71034383f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9293ecc8-771f-46d1-b766-87dba541e846", "name": "network-vif-plugged", "status": "completed", "tag": "de904479-c699-411b-bcd7-6cca91e2d75f"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:43:27.064107 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-204153b9-9caf-40cf-be00-edeed404eb19 req-5c954dea-7870-4768-8e77-f71034383f5f service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:27.064604 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-204153b9-9caf-40cf-be00-edeed404eb19 req-5c954dea-7870-4768-8e77-f71034383f5f service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:27.076209 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-204153b9-9caf-40cf-be00-edeed404eb19 req-5c954dea-7870-4768-8e77-f71034383f5f service nova] Creating event network-vif-plugged:de904479-c699-411b-bcd7-6cca91e2d75f for instance 9293ecc8-771f-46d1-b766-87dba541e846 on hv-cinder-80382 Jun 24 09:43:27.081334 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-204153b9-9caf-40cf-be00-edeed404eb19 req-5c954dea-7870-4768-8e77-f71034383f5f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029516 Jun 24 09:43:27.082218 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 114/227] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:43:27.531067 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-0f7f603e-83b8-4f54-ba57-e526563e156d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:27.532480 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-0f7f603e-83b8-4f54-ba57-e526563e156d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:27.546488 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7724bc68-a854-4fcd-a37f-f35626f35620 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:27.547467 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0f7f603e-83b8-4f54-ba57-e526563e156d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:27.547467 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0f7f603e-83b8-4f54-ba57-e526563e156d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:27.547760 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-7724bc68-a854-4fcd-a37f-f35626f35620 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:27.548716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0f7f603e-83b8-4f54-ba57-e526563e156d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:27.549154 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0f7f603e-83b8-4f54-ba57-e526563e156d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:27.557583 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7724bc68-a854-4fcd-a37f-f35626f35620 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:27.558326 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7724bc68-a854-4fcd-a37f-f35626f35620 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:27.559296 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7724bc68-a854-4fcd-a37f-f35626f35620 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:27.560035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7724bc68-a854-4fcd-a37f-f35626f35620 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:27.769002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-7724bc68-a854-4fcd-a37f-f35626f35620 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:27.769525 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-0f7f603e-83b8-4f54-ba57-e526563e156d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:27.777615 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-7724bc68-a854-4fcd-a37f-f35626f35620 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1521 microversion: 2.1 time: 0.238161 Jun 24 09:43:27.778224 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 115/228] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:27 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:27.778386 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-0f7f603e-83b8-4f54-ba57-e526563e156d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846" status: 200 len: 1313 microversion: 2.1 time: 0.253713 Jun 24 09:43:27.788045 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 114/229] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:27 2022] GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:27.788206 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3949ddb1-2469-452e-97db-9cfdaf029988 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:27.788206 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3949ddb1-2469-452e-97db-9cfdaf029988 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:27.790974 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3949ddb1-2469-452e-97db-9cfdaf029988 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:27.791446 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3949ddb1-2469-452e-97db-9cfdaf029988 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:27.792206 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3949ddb1-2469-452e-97db-9cfdaf029988 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:27.792667 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3949ddb1-2469-452e-97db-9cfdaf029988 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:27.936791 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3949ddb1-2469-452e-97db-9cfdaf029988 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:27.948092 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3949ddb1-2469-452e-97db-9cfdaf029988 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1319 microversion: 2.1 time: 0.168787 Jun 24 09:43:27.949671 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 116/230] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:27 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:28.795488 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-9b5f7cc3-8190-4cdc-8063-9c4beaf4c04d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:28.796057 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-30a604bc-f77a-45cc-9d17-303323ea3b7c tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:28.796412 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-9b5f7cc3-8190-4cdc-8063-9c4beaf4c04d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:28.796543 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-30a604bc-f77a-45cc-9d17-303323ea3b7c tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:28.803312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9b5f7cc3-8190-4cdc-8063-9c4beaf4c04d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:28.803476 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-30a604bc-f77a-45cc-9d17-303323ea3b7c tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:28.803757 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9b5f7cc3-8190-4cdc-8063-9c4beaf4c04d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:28.803857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-30a604bc-f77a-45cc-9d17-303323ea3b7c tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:28.804528 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9b5f7cc3-8190-4cdc-8063-9c4beaf4c04d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:28.804675 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-30a604bc-f77a-45cc-9d17-303323ea3b7c tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:28.804953 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9b5f7cc3-8190-4cdc-8063-9c4beaf4c04d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:28.805071 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-30a604bc-f77a-45cc-9d17-303323ea3b7c tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:28.819790 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=100 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:43:28.999685 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-30a604bc-f77a-45cc-9d17-303323ea3b7c tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:29.002979 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-9b5f7cc3-8190-4cdc-8063-9c4beaf4c04d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:29.007813 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-30a604bc-f77a-45cc-9d17-303323ea3b7c tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846" status: 200 len: 1313 microversion: 2.1 time: 0.215881 Jun 24 09:43:29.008361 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 117/231] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:28 2022] GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:29.012649 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-9b5f7cc3-8190-4cdc-8063-9c4beaf4c04d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1521 microversion: 2.1 time: 0.221126 Jun 24 09:43:29.013603 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e6e67abb-3f18-4e10-9c32-0b9f98c1ff71 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:29.014049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e6e67abb-3f18-4e10-9c32-0b9f98c1ff71 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:29.021678 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e6e67abb-3f18-4e10-9c32-0b9f98c1ff71 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:29.022311 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e6e67abb-3f18-4e10-9c32-0b9f98c1ff71 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:29.023113 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e6e67abb-3f18-4e10-9c32-0b9f98c1ff71 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:29.023566 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e6e67abb-3f18-4e10-9c32-0b9f98c1ff71 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:29.023823 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 115/232] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:28 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:29.163061 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e6e67abb-3f18-4e10-9c32-0b9f98c1ff71 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:29.170606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e6e67abb-3f18-4e10-9c32-0b9f98c1ff71 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1319 microversion: 2.1 time: 0.161217 Jun 24 09:43:29.171192 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 118/233] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:29 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:29.989259 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-635d976b-230a-46cf-ba1f-95ef744e7899 req-bed55bff-26d4-4b0b-ba8b-2a7fcb14f1ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0dadb5-652d-42b9-90aa-461f74d68dca", "name": "network-vif-plugged", "status": "completed", "tag": "572f669e-9d6a-459f-b60d-673ffe96ade9"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:43:29.998546 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-635d976b-230a-46cf-ba1f-95ef744e7899 req-bed55bff-26d4-4b0b-ba8b-2a7fcb14f1ed service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:29.999200 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-635d976b-230a-46cf-ba1f-95ef744e7899 req-bed55bff-26d4-4b0b-ba8b-2a7fcb14f1ed service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:30.012017 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-635d976b-230a-46cf-ba1f-95ef744e7899 req-bed55bff-26d4-4b0b-ba8b-2a7fcb14f1ed service nova] Creating event network-vif-plugged:572f669e-9d6a-459f-b60d-673ffe96ade9 for instance ce0dadb5-652d-42b9-90aa-461f74d68dca on hv-cinder-80382 Jun 24 09:43:30.017294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-635d976b-230a-46cf-ba1f-95ef744e7899 req-bed55bff-26d4-4b0b-ba8b-2a7fcb14f1ed service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032240 Jun 24 09:43:30.017940 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 116/234] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:43:30.026190 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7728cc2c-cde9-4a4c-8d21-8e8654b90c42 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:30.027366 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-7728cc2c-cde9-4a4c-8d21-8e8654b90c42 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:30.031109 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-995cc2c2-6a0c-42c0-94ac-20b0d30a84bf tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:30.031831 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-995cc2c2-6a0c-42c0-94ac-20b0d30a84bf tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:30.034533 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7728cc2c-cde9-4a4c-8d21-8e8654b90c42 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:30.034989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7728cc2c-cde9-4a4c-8d21-8e8654b90c42 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:30.035949 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7728cc2c-cde9-4a4c-8d21-8e8654b90c42 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:30.036387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7728cc2c-cde9-4a4c-8d21-8e8654b90c42 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:30.039300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-995cc2c2-6a0c-42c0-94ac-20b0d30a84bf tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:30.040379 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-995cc2c2-6a0c-42c0-94ac-20b0d30a84bf tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:30.041153 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-995cc2c2-6a0c-42c0-94ac-20b0d30a84bf tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:30.041636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-995cc2c2-6a0c-42c0-94ac-20b0d30a84bf tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:30.270219 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-7728cc2c-cde9-4a4c-8d21-8e8654b90c42 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:30.275620 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-995cc2c2-6a0c-42c0-94ac-20b0d30a84bf tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:30.278218 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-7728cc2c-cde9-4a4c-8d21-8e8654b90c42 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846" status: 200 len: 1496 microversion: 2.1 time: 0.256035 Jun 24 09:43:30.285028 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-995cc2c2-6a0c-42c0-94ac-20b0d30a84bf tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1521 microversion: 2.1 time: 0.257285 Jun 24 09:43:30.291130 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 117/235] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:30 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:30.291293 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 119/236] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:30 2022] GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846 => generated 1496 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:30.293592 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-173bb0c4-627c-48df-b4bf-cbd37e3743c1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:30.294247 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-173bb0c4-627c-48df-b4bf-cbd37e3743c1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:30.304917 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-173bb0c4-627c-48df-b4bf-cbd37e3743c1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:30.305495 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-173bb0c4-627c-48df-b4bf-cbd37e3743c1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:30.306579 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-173bb0c4-627c-48df-b4bf-cbd37e3743c1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:30.307018 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-173bb0c4-627c-48df-b4bf-cbd37e3743c1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:30.446567 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-173bb0c4-627c-48df-b4bf-cbd37e3743c1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:30.458531 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-173bb0c4-627c-48df-b4bf-cbd37e3743c1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1319 microversion: 2.1 time: 0.171476 Jun 24 09:43:30.459372 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 118/237] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:30 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:30.737216 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-dd00f2af-8130-428a-bfdc-1f40c03d62c4 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:30.737744 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-dd00f2af-8130-428a-bfdc-1f40c03d62c4 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:30.744034 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dd00f2af-8130-428a-bfdc-1f40c03d62c4 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:30.744487 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dd00f2af-8130-428a-bfdc-1f40c03d62c4 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:30.745269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dd00f2af-8130-428a-bfdc-1f40c03d62c4 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:30.745708 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dd00f2af-8130-428a-bfdc-1f40c03d62c4 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:30.776143 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-dd00f2af-8130-428a-bfdc-1f40c03d62c4 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] Going to try to terminate instance {{(pid=124339) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:43:30.790605 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=100 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:43:30.876249 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-dd00f2af-8130-428a-bfdc-1f40c03d62c4 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846" status: 204 len: 0 microversion: 2.1 time: 0.140306 Jun 24 09:43:30.877023 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 120/238] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:43:30 2022] DELETE /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:43:30.885859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-2d934ba7-8418-4732-97e5-0fb68af06014 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:30.886814 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-2d934ba7-8418-4732-97e5-0fb68af06014 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:30.893107 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2d934ba7-8418-4732-97e5-0fb68af06014 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:30.894001 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2d934ba7-8418-4732-97e5-0fb68af06014 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:30.894662 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2d934ba7-8418-4732-97e5-0fb68af06014 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:30.895429 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2d934ba7-8418-4732-97e5-0fb68af06014 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:31.039105 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-2d934ba7-8418-4732-97e5-0fb68af06014 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:31.047763 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-2d934ba7-8418-4732-97e5-0fb68af06014 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846" status: 200 len: 1502 microversion: 2.1 time: 0.166049 Jun 24 09:43:31.057447 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 119/239] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:30 2022] GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846 => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:31.303105 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a099e537-b4ff-4c16-99ee-87b7b2b40488 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:31.303921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-a099e537-b4ff-4c16-99ee-87b7b2b40488 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:31.310598 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a099e537-b4ff-4c16-99ee-87b7b2b40488 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:31.311133 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a099e537-b4ff-4c16-99ee-87b7b2b40488 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:31.312162 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a099e537-b4ff-4c16-99ee-87b7b2b40488 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:31.312700 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a099e537-b4ff-4c16-99ee-87b7b2b40488 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:31.476581 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-791c5f5a-a002-418e-925b-3284c884bdb2 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:31.477198 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-791c5f5a-a002-418e-925b-3284c884bdb2 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:31.483388 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-a099e537-b4ff-4c16-99ee-87b7b2b40488 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:31.483905 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-791c5f5a-a002-418e-925b-3284c884bdb2 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:31.484448 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-791c5f5a-a002-418e-925b-3284c884bdb2 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:31.485453 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-791c5f5a-a002-418e-925b-3284c884bdb2 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:31.485979 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-791c5f5a-a002-418e-925b-3284c884bdb2 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:31.491476 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-a099e537-b4ff-4c16-99ee-87b7b2b40488 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1501 microversion: 2.1 time: 0.192973 Jun 24 09:43:31.492249 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 121/240] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:31 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1501 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:31.509263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-31ff97a4-102f-4197-9463-c4098427c70b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd39510e-1a12-4e1d-9681-33c282278cfa"}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:43:31.510796 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-31ff97a4-102f-4197-9463-c4098427c70b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:31.516988 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-31ff97a4-102f-4197-9463-c4098427c70b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:31.517679 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-31ff97a4-102f-4197-9463-c4098427c70b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:31.518483 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-31ff97a4-102f-4197-9463-c4098427c70b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:31.518969 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-31ff97a4-102f-4197-9463-c4098427c70b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:31.544334 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-31ff97a4-102f-4197-9463-c4098427c70b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] HTTP exception thrown: Cannot 'attach_volume' instance 2135f6c7-0718-46fa-94a8-f948e487e37f while it is in vm_state rescued Jun 24 09:43:31.546002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-31ff97a4-102f-4197-9463-c4098427c70b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Request method failure captured: Jun 24 09:43:31.546002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: POST /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f/os-volume_attachments HTTP/1.1 Jun 24 09:43:31.546002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:43:31.546002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:43:31.546002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:43:31.546002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 74 Jun 24 09:43:31.546002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:43:31.546002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:43:31.546002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:43:31.546002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:43:31.546002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYbrg1PFIJaE9KsLUkvfj5MGavywSW_6-kKNWqXQtMtDM4NGVpy2qoJduFdeKzE6JHx1qIp1dD60a2_pl3EM8bMnRc1lIgF53oVZQgvtfcVbKMZo8_PxCPUz_4f9wAr5YVr6deH_wK059J2iU44YLzWTfVVv_g1WXnpsuU6S2iDXqX0 Jun 24 09:43:31.546002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:43:31.546002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:43:31.546002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:43:31.546002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:43:31.546002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:43:31.546002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:43:31.546002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 42946f76423740028ae43dc6a49cbbda Jun 24 09:43:31.546002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2069816343 Jun 24 09:43:31.546002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:43:31.546002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:43:31.547531 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_42946f76423740028ae43dc6a49cbbda", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/42946f76423740028ae43dc6a49cbbda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/42946f76423740028ae43dc6a49cbbda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/42946f76423740028ae43dc6a49cbbda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:43:31.547531 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2069816343 Jun 24 09:43:31.547531 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 42946f76423740028ae43dc6a49cbbda Jun 24 09:43:31.547531 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2069816343 Jun 24 09:43:31.547531 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-ServerRescueNegativeTestJSON-2069816343-project Jun 24 09:43:31.547531 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:43:31.547531 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:43:31.547531 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: d5e6d9fad06449c1b43254df442d224f Jun 24 09:43:31.547531 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2069816343-project Jun 24 09:43:31.547531 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Jun 24 09:43:31.547531 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {"volumeAttachment": {"volumeId": "cd39510e-1a12-4e1d-9681-33c282278cfa"}} Jun 24 09:43:31.547531 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:43:31.548416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Cannot 'attach_volume' instance 2135f6c7-0718-46fa-94a8-f948e487e37f while it is in vm_state rescued Jun 24 09:43:31.548416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'server_id': '2135f6c7-0718-46fa-94a8-f948e487e37f', 'body': {'volumeAttachment': {'volumeId': 'cd39510e-1a12-4e1d-9681-33c282278cfa'}}} Jun 24 09:43:31.548416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:43:31.548416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:43:31.548416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 09:43:31.548416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 09:43:31.548416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 09:43:31.548416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:43:31.548416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 24 09:43:31.548416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 24 09:43:31.548416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2135f6c7-0718-46fa-94a8-f948e487e37f in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 24 09:43:31.548416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:31.548416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:43:31.548416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:31.548416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:43:31.548416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:43:31.548416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:43:31.548416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:43:31.548416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:43:31.549770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:43:31.549770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:43:31.549770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 09:43:31.549770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 09:43:31.549770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 09:43:31.549770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 09:43:31.549770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 09:43:31.549770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 09:43:31.549770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 24 09:43:31.549770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 24 09:43:31.549770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 24 09:43:31.549770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 24 09:43:31.549770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2135f6c7-0718-46fa-94a8-f948e487e37f while it is in vm_state rescued Jun 24 09:43:31.549770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:31.549770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:43:31.549770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:31.549770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:43:31.549770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:43:31.549770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:43:31.551375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:43:31.551375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:43:31.551375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2135f6c7-0718-46fa-94a8-f948e487e37f while it is in vm_state rescued Jun 24 09:43:31.551375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:31.551375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-31ff97a4-102f-4197-9463-c4098427c70b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Returning 409 to user: Cannot 'attach_volume' instance 2135f6c7-0718-46fa-94a8-f948e487e37f while it is in vm_state rescued {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:43:31.551375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-31ff97a4-102f-4197-9463-c4098427c70b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "POST /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042443 Jun 24 09:43:31.551375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 122/241] 10.222.0.65 () {60 vars in 1322 bytes} [Fri Jun 24 09:43:31 2022] POST /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 24 09:43:31.557694 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-743ec318-6cd0-4fcb-8292-8d74b90d3036 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:43:31.558476 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-743ec318-6cd0-4fcb-8292-8d74b90d3036 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:31.566247 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-743ec318-6cd0-4fcb-8292-8d74b90d3036 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:31.566734 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-743ec318-6cd0-4fcb-8292-8d74b90d3036 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:31.567656 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-743ec318-6cd0-4fcb-8292-8d74b90d3036 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:31.568145 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-743ec318-6cd0-4fcb-8292-8d74b90d3036 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:31.637087 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-791c5f5a-a002-418e-925b-3284c884bdb2 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:31.641947 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-743ec318-6cd0-4fcb-8292-8d74b90d3036 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "POST /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f/action" status: 202 len: 0 microversion: 2.1 time: 0.088862 Jun 24 09:43:31.646566 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 123/242] 10.222.0.65 () {60 vars in 1277 bytes} [Fri Jun 24 09:43:31 2022] POST /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 09:43:31.659859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-791c5f5a-a002-418e-925b-3284c884bdb2 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1319 microversion: 2.1 time: 0.186757 Jun 24 09:43:31.660813 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 120/243] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:31 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:31.663879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b0ffcef0-fa10-4553-9b2d-74080f9233bb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:31.664831 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-b0ffcef0-fa10-4553-9b2d-74080f9233bb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:31.672124 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b0ffcef0-fa10-4553-9b2d-74080f9233bb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:31.672631 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b0ffcef0-fa10-4553-9b2d-74080f9233bb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:31.673397 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b0ffcef0-fa10-4553-9b2d-74080f9233bb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:31.674012 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b0ffcef0-fa10-4553-9b2d-74080f9233bb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:31.879767 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b0ffcef0-fa10-4553-9b2d-74080f9233bb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:31.889282 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b0ffcef0-fa10-4553-9b2d-74080f9233bb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1509 microversion: 2.1 time: 0.240835 Jun 24 09:43:31.890580 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 124/244] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:31 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1509 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:43:32.064938 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-df4a2d09-98d9-47bf-8330-2e5e7856725d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:32.065628 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-df4a2d09-98d9-47bf-8330-2e5e7856725d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:32.072740 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-df4a2d09-98d9-47bf-8330-2e5e7856725d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:32.073168 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-df4a2d09-98d9-47bf-8330-2e5e7856725d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:32.074022 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-df4a2d09-98d9-47bf-8330-2e5e7856725d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:32.074571 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-df4a2d09-98d9-47bf-8330-2e5e7856725d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:32.217744 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-df4a2d09-98d9-47bf-8330-2e5e7856725d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:32.226294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-df4a2d09-98d9-47bf-8330-2e5e7856725d tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846" status: 200 len: 1502 microversion: 2.1 time: 0.165247 Jun 24 09:43:32.226885 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 121/245] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:32 2022] GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846 => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:32.678468 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b60d81de-e810-4160-8704-9e3979241a78 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:32.679160 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-b60d81de-e810-4160-8704-9e3979241a78 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:32.686137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b60d81de-e810-4160-8704-9e3979241a78 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:32.686555 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b60d81de-e810-4160-8704-9e3979241a78 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:32.687350 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b60d81de-e810-4160-8704-9e3979241a78 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:32.687765 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b60d81de-e810-4160-8704-9e3979241a78 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:32.908715 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-22036157-cb63-4238-bc82-ca54877aaf9b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:32.910462 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-22036157-cb63-4238-bc82-ca54877aaf9b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:32.917282 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-22036157-cb63-4238-bc82-ca54877aaf9b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:32.917827 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-22036157-cb63-4238-bc82-ca54877aaf9b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:32.918768 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-22036157-cb63-4238-bc82-ca54877aaf9b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:32.919223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-22036157-cb63-4238-bc82-ca54877aaf9b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:33.090859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b60d81de-e810-4160-8704-9e3979241a78 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:33.100363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b60d81de-e810-4160-8704-9e3979241a78 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1319 microversion: 2.1 time: 0.425792 Jun 24 09:43:33.101359 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 125/246] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:32 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1319 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:33.114205 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-22036157-cb63-4238-bc82-ca54877aaf9b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:33.123342 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-22036157-cb63-4238-bc82-ca54877aaf9b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1509 microversion: 2.1 time: 0.219666 Jun 24 09:43:33.123955 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 122/247] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:32 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1509 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:43:33.245809 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-ac902ef2-41f1-4639-819e-444a21810b70 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:33.246394 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-ac902ef2-41f1-4639-819e-444a21810b70 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:33.253072 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ac902ef2-41f1-4639-819e-444a21810b70 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:33.253582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ac902ef2-41f1-4639-819e-444a21810b70 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:33.254438 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ac902ef2-41f1-4639-819e-444a21810b70 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:33.254917 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ac902ef2-41f1-4639-819e-444a21810b70 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:33.497051 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ac902ef2-41f1-4639-819e-444a21810b70 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:33.507450 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-ac902ef2-41f1-4639-819e-444a21810b70 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846" status: 200 len: 1502 microversion: 2.1 time: 0.265383 Jun 24 09:43:33.508058 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 126/248] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:33 2022] GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846 => generated 1502 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:33.857068 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-bc7f555e-9caa-44ea-8d5b-6adea52b0050 req-9074594e-f367-44bd-b51f-86bcbabaca24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9293ecc8-771f-46d1-b766-87dba541e846", "name": "network-vif-deleted", "tag": "de904479-c699-411b-bcd7-6cca91e2d75f"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:43:33.865595 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-bc7f555e-9caa-44ea-8d5b-6adea52b0050 req-9074594e-f367-44bd-b51f-86bcbabaca24 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:33.865964 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-bc7f555e-9caa-44ea-8d5b-6adea52b0050 req-9074594e-f367-44bd-b51f-86bcbabaca24 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:33.877279 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-bc7f555e-9caa-44ea-8d5b-6adea52b0050 req-9074594e-f367-44bd-b51f-86bcbabaca24 service nova] Creating event network-vif-deleted:de904479-c699-411b-bcd7-6cca91e2d75f for instance 9293ecc8-771f-46d1-b766-87dba541e846 on hv-cinder-80382 Jun 24 09:43:33.882787 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-bc7f555e-9caa-44ea-8d5b-6adea52b0050 req-9074594e-f367-44bd-b51f-86bcbabaca24 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029755 Jun 24 09:43:33.883886 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 123/249] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:43:34.118070 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-caa4d1b4-5216-41ba-a2d6-fff5e0ca9b49 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:34.118651 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-caa4d1b4-5216-41ba-a2d6-fff5e0ca9b49 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:34.125049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-caa4d1b4-5216-41ba-a2d6-fff5e0ca9b49 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:34.125497 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-caa4d1b4-5216-41ba-a2d6-fff5e0ca9b49 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:34.126246 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-caa4d1b4-5216-41ba-a2d6-fff5e0ca9b49 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:34.126679 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-caa4d1b4-5216-41ba-a2d6-fff5e0ca9b49 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:34.154616 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-92612dd7-3cdb-41b7-993d-914fac6ee6d2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:34.155553 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-92612dd7-3cdb-41b7-993d-914fac6ee6d2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:34.168724 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-92612dd7-3cdb-41b7-993d-914fac6ee6d2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:34.171365 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-92612dd7-3cdb-41b7-993d-914fac6ee6d2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:34.172205 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-92612dd7-3cdb-41b7-993d-914fac6ee6d2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:34.172822 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-92612dd7-3cdb-41b7-993d-914fac6ee6d2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:34.337937 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-caa4d1b4-5216-41ba-a2d6-fff5e0ca9b49 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:34.346412 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-caa4d1b4-5216-41ba-a2d6-fff5e0ca9b49 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1319 microversion: 2.1 time: 0.232199 Jun 24 09:43:34.347235 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 127/250] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:34 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:34.378863 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-92612dd7-3cdb-41b7-993d-914fac6ee6d2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:34.387885 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-92612dd7-3cdb-41b7-993d-914fac6ee6d2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1509 microversion: 2.1 time: 0.249828 Jun 24 09:43:34.388804 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 124/251] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:34 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1509 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:34.526037 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-9fb8ebe9-c2b2-431c-808f-b564ec6bde13 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:34.526726 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-9fb8ebe9-c2b2-431c-808f-b564ec6bde13 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:34.534351 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:43:34.536689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9fb8ebe9-c2b2-431c-808f-b564ec6bde13 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:34.537770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9fb8ebe9-c2b2-431c-808f-b564ec6bde13 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:34.538759 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9fb8ebe9-c2b2-431c-808f-b564ec6bde13 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:34.539470 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9fb8ebe9-c2b2-431c-808f-b564ec6bde13 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:34.585751 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9fb8ebe9-c2b2-431c-808f-b564ec6bde13 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:34.586211 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9fb8ebe9-c2b2-431c-808f-b564ec6bde13 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:34.586662 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.objects.instance [None req-9fb8ebe9-c2b2-431c-808f-b564ec6bde13 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lazy-loading 'fault' on Instance uuid 9293ecc8-771f-46d1-b766-87dba541e846 {{(pid=124339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:43:34.636735 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-9fb8ebe9-c2b2-431c-808f-b564ec6bde13 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:34.649105 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-9fb8ebe9-c2b2-431c-808f-b564ec6bde13 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846" status: 200 len: 1303 microversion: 2.1 time: 0.127210 Jun 24 09:43:34.649716 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 128/252] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:34 2022] GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846 => generated 1303 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:35.368227 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7ac2897e-23a1-4283-8aa4-2c6a997de8a6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:35.369095 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-7ac2897e-23a1-4283-8aa4-2c6a997de8a6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:35.380321 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7ac2897e-23a1-4283-8aa4-2c6a997de8a6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:35.380770 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7ac2897e-23a1-4283-8aa4-2c6a997de8a6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:35.381541 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7ac2897e-23a1-4283-8aa4-2c6a997de8a6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:35.381967 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7ac2897e-23a1-4283-8aa4-2c6a997de8a6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:35.405653 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-8e585034-fb2b-477e-852c-f918bac76b12 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:35.406302 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-8e585034-fb2b-477e-852c-f918bac76b12 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:35.412842 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8e585034-fb2b-477e-852c-f918bac76b12 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:35.413313 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8e585034-fb2b-477e-852c-f918bac76b12 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:35.414058 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8e585034-fb2b-477e-852c-f918bac76b12 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:35.414489 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8e585034-fb2b-477e-852c-f918bac76b12 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:35.580944 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-7ac2897e-23a1-4283-8aa4-2c6a997de8a6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:35.589726 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-7ac2897e-23a1-4283-8aa4-2c6a997de8a6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1508 microversion: 2.1 time: 0.228158 Jun 24 09:43:35.590724 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 125/253] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:35 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:35.593193 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-8e585034-fb2b-477e-852c-f918bac76b12 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:35.602819 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-8e585034-fb2b-477e-852c-f918bac76b12 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1509 microversion: 2.1 time: 0.200943 Jun 24 09:43:35.603952 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 129/254] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:35 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1509 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:35.668849 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-8f959bf7-fcff-4251-ae35-341f432bc095 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:35.669582 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-8f959bf7-fcff-4251-ae35-341f432bc095 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:35.677678 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8f959bf7-fcff-4251-ae35-341f432bc095 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:35.678141 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8f959bf7-fcff-4251-ae35-341f432bc095 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:35.678880 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8f959bf7-fcff-4251-ae35-341f432bc095 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:35.679358 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8f959bf7-fcff-4251-ae35-341f432bc095 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:35.722604 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8f959bf7-fcff-4251-ae35-341f432bc095 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:35.723261 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8f959bf7-fcff-4251-ae35-341f432bc095 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:35.723898 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.objects.instance [None req-8f959bf7-fcff-4251-ae35-341f432bc095 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lazy-loading 'fault' on Instance uuid 9293ecc8-771f-46d1-b766-87dba541e846 {{(pid=124338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:43:35.776941 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-8f959bf7-fcff-4251-ae35-341f432bc095 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:35.784866 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-8f959bf7-fcff-4251-ae35-341f432bc095 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846" status: 200 len: 1303 microversion: 2.1 time: 0.119909 Jun 24 09:43:35.785442 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 126/255] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:35 2022] GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846 => generated 1303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:43:36.622064 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c9f11a58-6cf5-410a-baa9-f71209cf1c23 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:36.622665 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-c9f11a58-6cf5-410a-baa9-f71209cf1c23 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:36.629524 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c9f11a58-6cf5-410a-baa9-f71209cf1c23 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:36.630159 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c9f11a58-6cf5-410a-baa9-f71209cf1c23 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:36.631610 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c9f11a58-6cf5-410a-baa9-f71209cf1c23 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:36.631610 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c9f11a58-6cf5-410a-baa9-f71209cf1c23 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:36.804332 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-6514ad18-cf46-4f98-9d0b-00029d3586b7 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:36.804977 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-6514ad18-cf46-4f98-9d0b-00029d3586b7 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:36.812237 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6514ad18-cf46-4f98-9d0b-00029d3586b7 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:36.812349 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6514ad18-cf46-4f98-9d0b-00029d3586b7 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:36.812787 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c9f11a58-6cf5-410a-baa9-f71209cf1c23 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:36.813285 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6514ad18-cf46-4f98-9d0b-00029d3586b7 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:36.813731 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6514ad18-cf46-4f98-9d0b-00029d3586b7 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:36.821077 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-c9f11a58-6cf5-410a-baa9-f71209cf1c23 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1515 microversion: 2.1 time: 0.203668 Jun 24 09:43:36.821638 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 130/256] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:36 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1515 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:36.856035 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6514ad18-cf46-4f98-9d0b-00029d3586b7 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:36.856486 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6514ad18-cf46-4f98-9d0b-00029d3586b7 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:36.856937 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.objects.instance [None req-6514ad18-cf46-4f98-9d0b-00029d3586b7 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lazy-loading 'fault' on Instance uuid 9293ecc8-771f-46d1-b766-87dba541e846 {{(pid=124338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:43:36.925260 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-6514ad18-cf46-4f98-9d0b-00029d3586b7 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4d2ec6d0014c99a818e1000869b38c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b285a04564d5d917a4566bec984b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:36.936989 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-6514ad18-cf46-4f98-9d0b-00029d3586b7 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846" status: 200 len: 1303 microversion: 2.1 time: 0.136701 Jun 24 09:43:36.937769 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 127/257] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:36 2022] GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846 => generated 1303 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:37.954697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7377b76a-11b0-4ca5-bf76-8520af261614 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:37.955405 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-7377b76a-11b0-4ca5-bf76-8520af261614 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] [instance: 9293ecc8-771f-46d1-b766-87dba541e846] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:37.962745 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7377b76a-11b0-4ca5-bf76-8520af261614 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:37.963227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7377b76a-11b0-4ca5-bf76-8520af261614 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:37.963991 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7377b76a-11b0-4ca5-bf76-8520af261614 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:37.964406 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7377b76a-11b0-4ca5-bf76-8520af261614 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:37.981119 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-7377b76a-11b0-4ca5-bf76-8520af261614 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] HTTP exception thrown: Instance 9293ecc8-771f-46d1-b766-87dba541e846 could not be found. Jun 24 09:43:37.982898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7377b76a-11b0-4ca5-bf76-8520af261614 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Request method failure captured: Jun 24 09:43:37.982898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846 HTTP/1.1 Jun 24 09:43:37.982898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:43:37.982898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:43:37.982898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:43:37.982898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:43:37.982898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:43:37.982898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:43:37.982898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:43:37.982898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:43:37.982898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYcUCbfMbWpYGGYs-p-ddGbgpfZpxhMAaru7ay-DLsasV-YYyeQZ9_ZF5BrVtS4mzVsJrZZLTyhGVvyztwphfJnRWOL2wz9ClribuqMUhcRwcNq5gUV2WGQCMxv_Z-FveGX6bY4VJZajBE9i1oIrwvDIH67RW85-fOtaatUdf_NBIcI Jun 24 09:43:37.982898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:43:37.982898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:43:37.982898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:43:37.982898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:43:37.982898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:43:37.982898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:43:37.982898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 6c5b285a04564d5d917a4566bec984b2 Jun 24 09:43:37.982898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-VolumesActionsTest-404609107 Jun 24 09:43:37.982898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:43:37.982898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:43:37.984609 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6c5b285a04564d5d917a4566bec984b2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6c5b285a04564d5d917a4566bec984b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6c5b285a04564d5d917a4566bec984b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6c5b285a04564d5d917a4566bec984b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:43:37.984609 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-VolumesActionsTest-404609107 Jun 24 09:43:37.984609 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 6c5b285a04564d5d917a4566bec984b2 Jun 24 09:43:37.984609 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-VolumesActionsTest-404609107 Jun 24 09:43:37.984609 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-VolumesActionsTest-404609107-project Jun 24 09:43:37.984609 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:43:37.984609 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:43:37.984609 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: 1e4d2ec6d0014c99a818e1000869b38c Jun 24 09:43:37.984609 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-VolumesActionsTest-404609107-project Jun 24 09:43:37.984609 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:43:37.984609 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance 9293ecc8-771f-46d1-b766-87dba541e846 could not be found. Jun 24 09:43:37.984609 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': '9293ecc8-771f-46d1-b766-87dba541e846'} Jun 24 09:43:37.985463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:43:37.985463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:43:37.985463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:43:37.985463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:43:37.985463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:43:37.985463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:43:37.985463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:43:37.985463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:43:37.985463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:43:37.985463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:43:37.985463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9293ecc8-771f-46d1-b766-87dba541e846 could not be found. Jun 24 09:43:37.985463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:37.985463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:43:37.985463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:37.985463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:43:37.985463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:43:37.985463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:43:37.985463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:43:37.985463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:43:37.985463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:43:37.987035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:43:37.987035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:43:37.987035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:43:37.987035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:43:37.987035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:43:37.987035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:43:37.987035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:43:37.987035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9293ecc8-771f-46d1-b766-87dba541e846 could not be found. Jun 24 09:43:37.987035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:37.987035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:43:37.987035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:37.987035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:43:37.987035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:43:37.987035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:43:37.987035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:43:37.987035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:43:37.987035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9293ecc8-771f-46d1-b766-87dba541e846 could not be found. Jun 24 09:43:37.987035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:43:37.988286 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7377b76a-11b0-4ca5-bf76-8520af261614 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] Returning 404 to user: Instance 9293ecc8-771f-46d1-b766-87dba541e846 could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:43:37.988286 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-7377b76a-11b0-4ca5-bf76-8520af261614 tempest-VolumesActionsTest-404609107 tempest-VolumesActionsTest-404609107-project] 10.222.0.65 "GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846" status: 404 len: 111 microversion: 2.1 time: 0.033856 Jun 24 09:43:37.988286 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 131/258] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:37 2022] GET /compute/v2.1/servers/9293ecc8-771f-46d1-b766-87dba541e846 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:43:38.337295 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-f14bfd11-98a7-4cbe-b30d-0af35eb1a0a0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Action: 'create', calling method: .version_select at 0x7fc6d5808c10>, body: {"keypair": {"name": "tempest-keypair-564442657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQtHla90fzG+7OoSQVBeeaMloO5IxYAQLKmAfIRlrNAHQDZsetYReeFGtN+xVwDtGCNyQrIi+zrhpQE/qS4YWFqjJ2EI6Ac2HHYZkswXoOHpkveGfMJm01QQqTXfMMpDg=="}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:43:38.359848 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-f14bfd11-98a7-4cbe-b30d-0af35eb1a0a0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Getting quotas for project 42946f76423740028ae43dc6a49cbbda. Resources: {'key_pairs'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:43:38.366520 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-f14bfd11-98a7-4cbe-b30d-0af35eb1a0a0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Getting quotas for user d5e6d9fad06449c1b43254df442d224f and project 42946f76423740028ae43dc6a49cbbda. Resources: {'key_pairs'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:43:38.393596 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-f14bfd11-98a7-4cbe-b30d-0af35eb1a0a0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061401 Jun 24 09:43:38.394295 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 128/259] 10.222.0.65 () {60 vars in 1158 bytes} [Fri Jun 24 09:43:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:43:39.732903 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-0b0b06e4-5b05-44bc-8643-7d05e6432406 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-743571890", "imageRef": "844ad823-18a2-4abc-813c-2d1825141591", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eee14dfc-24f3-458e-880d-b3e43ab7d14d"}], "security_groups": [{"name": "tempest-securitygroup--1324738666"}], "key_name": "tempest-keypair-564442657", "user_data": "}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:43:45.988841 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.network.neutron [None req-0b0b06e4-5b05-44bc-8643-7d05e6432406 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] validate_networks() for [('eee14dfc-24f3-458e-880d-b3e43ab7d14d', None, None, None, None, None)] {{(pid=124339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:43:46.377717 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-0b0b06e4-5b05-44bc-8643-7d05e6432406 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Flavor limits 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:43:46.378214 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-0b0b06e4-5b05-44bc-8643-7d05e6432406 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Image limits 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:43:46.378693 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-0b0b06e4-5b05-44bc-8643-7d05e6432406 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Flavor pref 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:43:46.379126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-0b0b06e4-5b05-44bc-8643-7d05e6432406 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Image pref 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:43:46.379562 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-0b0b06e4-5b05-44bc-8643-7d05e6432406 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:43:46.390077 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0b0b06e4-5b05-44bc-8643-7d05e6432406 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:46.390637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0b0b06e4-5b05-44bc-8643-7d05e6432406 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:46.391749 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0b0b06e4-5b05-44bc-8643-7d05e6432406 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:46.392220 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0b0b06e4-5b05-44bc-8643-7d05e6432406 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:46.411686 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-0b0b06e4-5b05-44bc-8643-7d05e6432406 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Getting quotas for project 42946f76423740028ae43dc6a49cbbda. Resources: {'cores', 'ram', 'instances'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:43:46.415969 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-0b0b06e4-5b05-44bc-8643-7d05e6432406 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Getting quotas for user d5e6d9fad06449c1b43254df442d224f and project 42946f76423740028ae43dc6a49cbbda. Resources: {'cores', 'ram', 'instances'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:43:46.427952 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-0b0b06e4-5b05-44bc-8643-7d05e6432406 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Going to run 1 instances... {{(pid=124339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:43:46.430272 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-0b0b06e4-5b05-44bc-8643-7d05e6432406 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='844ad823-18a2-4abc-813c-2d1825141591',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:43:46.480527 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-0b0b06e4-5b05-44bc-8643-7d05e6432406 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 6.751746 Jun 24 09:43:46.481165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 132/260] 10.222.0.65 () {60 vars in 1146 bytes} [Fri Jun 24 09:43:39 2022] POST /compute/v2.1/servers => generated 409 bytes in 6754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 09:43:46.492368 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-30d7fde5-ed40-47a4-bea7-32ee8d0c4275 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:46.492980 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-30d7fde5-ed40-47a4-bea7-32ee8d0c4275 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:46.494923 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:43:46.554753 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-30d7fde5-ed40-47a4-bea7-32ee8d0c4275 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:46.562551 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-30d7fde5-ed40-47a4-bea7-32ee8d0c4275 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1244 microversion: 2.1 time: 0.075040 Jun 24 09:43:46.563171 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 129/261] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:46 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1244 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:47.110821 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-df9033d4-e046-4ee4-8bbb-20982c1b47ab tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:47.111343 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-df9033d4-e046-4ee4-8bbb-20982c1b47ab tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:47.118409 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-df9033d4-e046-4ee4-8bbb-20982c1b47ab tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:47.118868 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-df9033d4-e046-4ee4-8bbb-20982c1b47ab tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:47.119682 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-df9033d4-e046-4ee4-8bbb-20982c1b47ab tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:47.120176 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-df9033d4-e046-4ee4-8bbb-20982c1b47ab tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:47.143980 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-df9033d4-e046-4ee4-8bbb-20982c1b47ab tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69/ips" status: 200 len: 151 microversion: 2.20 time: 0.037100 Jun 24 09:43:47.144563 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 133/262] 10.222.0.65 () {60 vars in 1288 bytes} [Fri Jun 24 09:43:47 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:43:47.582204 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-f0d63bfd-c1a7-4091-bdee-0e35eccdd014 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:47.582720 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-f0d63bfd-c1a7-4091-bdee-0e35eccdd014 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:47.584579 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=71 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:43:47.592253 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f0d63bfd-c1a7-4091-bdee-0e35eccdd014 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:47.592691 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f0d63bfd-c1a7-4091-bdee-0e35eccdd014 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:47.593556 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f0d63bfd-c1a7-4091-bdee-0e35eccdd014 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:47.593990 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f0d63bfd-c1a7-4091-bdee-0e35eccdd014 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:47.656947 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f0d63bfd-c1a7-4091-bdee-0e35eccdd014 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:47.664905 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-f0d63bfd-c1a7-4091-bdee-0e35eccdd014 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1248 microversion: 2.1 time: 0.086725 Jun 24 09:43:47.665484 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 130/263] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:47 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1248 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:48.684501 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-bf0ddf38-c523-42e0-a8e1-edcc1c2d54db tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:48.685140 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-bf0ddf38-c523-42e0-a8e1-edcc1c2d54db tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:48.694826 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bf0ddf38-c523-42e0-a8e1-edcc1c2d54db tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:48.695508 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bf0ddf38-c523-42e0-a8e1-edcc1c2d54db tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:48.696604 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bf0ddf38-c523-42e0-a8e1-edcc1c2d54db tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:48.697243 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bf0ddf38-c523-42e0-a8e1-edcc1c2d54db tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:48.769904 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-bf0ddf38-c523-42e0-a8e1-edcc1c2d54db tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:48.778830 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-bf0ddf38-c523-42e0-a8e1-edcc1c2d54db tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1248 microversion: 2.1 time: 0.100039 Jun 24 09:43:48.779455 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 134/264] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:48 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1248 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:49.796802 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-2e2749f7-b8c7-4bb8-b1f5-ff8863af5956 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:49.797448 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-2e2749f7-b8c7-4bb8-b1f5-ff8863af5956 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:49.804756 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2e2749f7-b8c7-4bb8-b1f5-ff8863af5956 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:49.805208 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2e2749f7-b8c7-4bb8-b1f5-ff8863af5956 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:49.806053 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2e2749f7-b8c7-4bb8-b1f5-ff8863af5956 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:49.806503 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2e2749f7-b8c7-4bb8-b1f5-ff8863af5956 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:49.881941 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-2e2749f7-b8c7-4bb8-b1f5-ff8863af5956 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:49.893554 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-2e2749f7-b8c7-4bb8-b1f5-ff8863af5956 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1296 microversion: 2.1 time: 0.100672 Jun 24 09:43:49.894122 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 131/265] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:49 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1296 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:50.919585 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7e94f0df-9ce3-487a-8a41-afed16de7d1f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:50.920864 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-7e94f0df-9ce3-487a-8a41-afed16de7d1f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:50.928018 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7e94f0df-9ce3-487a-8a41-afed16de7d1f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:50.928463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7e94f0df-9ce3-487a-8a41-afed16de7d1f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:50.929236 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7e94f0df-9ce3-487a-8a41-afed16de7d1f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:50.929662 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7e94f0df-9ce3-487a-8a41-afed16de7d1f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:51.063113 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-7e94f0df-9ce3-487a-8a41-afed16de7d1f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:51.076430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-7e94f0df-9ce3-487a-8a41-afed16de7d1f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1370 microversion: 2.1 time: 0.162241 Jun 24 09:43:51.077573 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 135/266] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:50 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:51.574396 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-f5280a35-a5be-48d4-a85d-913accc07209 req-28c0a95a-9490-4897-8dd3-68835bc34971 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64", "tag": "604c79af-8cff-4ce1-90d3-2991416e7b7f"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:43:51.593938 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-f5280a35-a5be-48d4-a85d-913accc07209 req-28c0a95a-9490-4897-8dd3-68835bc34971 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:51.594665 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-f5280a35-a5be-48d4-a85d-913accc07209 req-28c0a95a-9490-4897-8dd3-68835bc34971 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:51.617674 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-f5280a35-a5be-48d4-a85d-913accc07209 req-28c0a95a-9490-4897-8dd3-68835bc34971 service nova] Creating event network-changed:604c79af-8cff-4ce1-90d3-2991416e7b7f for instance 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 on hv-cinder-80382 Jun 24 09:43:51.625965 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-f5280a35-a5be-48d4-a85d-913accc07209 req-28c0a95a-9490-4897-8dd3-68835bc34971 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056000 Jun 24 09:43:51.627613 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 132/267] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:43:52.094693 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-38d559c6-6f6e-4a2c-92f9-25d3476c00fa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:52.095825 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-38d559c6-6f6e-4a2c-92f9-25d3476c00fa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:52.112169 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-38d559c6-6f6e-4a2c-92f9-25d3476c00fa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:52.112737 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-38d559c6-6f6e-4a2c-92f9-25d3476c00fa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:52.113646 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-38d559c6-6f6e-4a2c-92f9-25d3476c00fa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:52.114157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-38d559c6-6f6e-4a2c-92f9-25d3476c00fa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:52.151503 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-8339fe73-ab19-493b-9a36-e9329743bb82 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:43:52.152831 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-8339fe73-ab19-493b-9a36-e9329743bb82 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:52.164375 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8339fe73-ab19-493b-9a36-e9329743bb82 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:52.165059 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8339fe73-ab19-493b-9a36-e9329743bb82 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:52.166118 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8339fe73-ab19-493b-9a36-e9329743bb82 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:52.166757 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8339fe73-ab19-493b-9a36-e9329743bb82 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:52.236608 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.objects.instance [None req-8339fe73-ab19-493b-9a36-e9329743bb82 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lazy-loading 'flavor' on Instance uuid aa551ac0-154e-4145-acc0-725155004e69 {{(pid=124338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:43:52.275867 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-38d559c6-6f6e-4a2c-92f9-25d3476c00fa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:52.279508 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:43:52.285774 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-38d559c6-6f6e-4a2c-92f9-25d3476c00fa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1370 microversion: 2.1 time: 0.195286 Jun 24 09:43:52.286813 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 136/268] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:52 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:53.306678 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-83f59d5d-016d-408d-a295-f9dc5eab59a7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:53.307650 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-83f59d5d-016d-408d-a295-f9dc5eab59a7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:53.314350 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-83f59d5d-016d-408d-a295-f9dc5eab59a7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:53.314908 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-83f59d5d-016d-408d-a295-f9dc5eab59a7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:53.315879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-83f59d5d-016d-408d-a295-f9dc5eab59a7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:53.316346 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-83f59d5d-016d-408d-a295-f9dc5eab59a7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:53.526532 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-83f59d5d-016d-408d-a295-f9dc5eab59a7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:53.537186 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-83f59d5d-016d-408d-a295-f9dc5eab59a7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1370 microversion: 2.1 time: 0.234550 Jun 24 09:43:53.546563 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 137/269] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:53 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1370 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:43:54.274826 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-38d9d553-d565-4a59-8d93-ec71d37d14a7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:54.275694 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-38d9d553-d565-4a59-8d93-ec71d37d14a7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:54.286813 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-38d9d553-d565-4a59-8d93-ec71d37d14a7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:54.287979 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-38d9d553-d565-4a59-8d93-ec71d37d14a7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:54.288864 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-38d9d553-d565-4a59-8d93-ec71d37d14a7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:54.289555 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-38d9d553-d565-4a59-8d93-ec71d37d14a7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:54.320407 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-38d9d553-d565-4a59-8d93-ec71d37d14a7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef/ips" status: 200 len: 149 microversion: 2.1 time: 0.049827 Jun 24 09:43:54.323058 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 138/270] 10.222.0.65 () {58 vars in 1247 bytes} [Fri Jun 24 09:43:54 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef/ips => generated 149 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:43:54.558279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-86c36154-a969-4526-94b5-2cb035e73835 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:54.560456 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-86c36154-a969-4526-94b5-2cb035e73835 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:54.577280 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-86c36154-a969-4526-94b5-2cb035e73835 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:54.578402 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-86c36154-a969-4526-94b5-2cb035e73835 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:54.579852 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-86c36154-a969-4526-94b5-2cb035e73835 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:54.580548 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-86c36154-a969-4526-94b5-2cb035e73835 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:54.794807 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-86c36154-a969-4526-94b5-2cb035e73835 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:54.828872 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-86c36154-a969-4526-94b5-2cb035e73835 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1370 microversion: 2.1 time: 0.277846 Jun 24 09:43:54.837913 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 139/271] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:54 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1370 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:55.849901 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-2fdca022-93ee-417d-ae63-199a9ed55a13 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:55.851019 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-2fdca022-93ee-417d-ae63-199a9ed55a13 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:55.862466 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2fdca022-93ee-417d-ae63-199a9ed55a13 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:55.863233 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2fdca022-93ee-417d-ae63-199a9ed55a13 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:55.864217 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2fdca022-93ee-417d-ae63-199a9ed55a13 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:55.864833 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2fdca022-93ee-417d-ae63-199a9ed55a13 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:56.017222 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-2fdca022-93ee-417d-ae63-199a9ed55a13 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:56.027223 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-2fdca022-93ee-417d-ae63-199a9ed55a13 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1370 microversion: 2.1 time: 0.181105 Jun 24 09:43:56.038854 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 140/272] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:55 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:56.046166 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b74f7607-5338-4089-9da2-1c052be6514d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "519d9c43-fb95-426e-bbe1-6d82343cc12d"}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:43:56.047736 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-b74f7607-5338-4089-9da2-1c052be6514d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:56.055374 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b74f7607-5338-4089-9da2-1c052be6514d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:56.056189 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b74f7607-5338-4089-9da2-1c052be6514d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:56.057317 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b74f7607-5338-4089-9da2-1c052be6514d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:56.058199 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b74f7607-5338-4089-9da2-1c052be6514d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:56.401545 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=2 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:43:56.426104 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=6 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:43:56.517369 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b74f7607-5338-4089-9da2-1c052be6514d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "POST /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.476621 Jun 24 09:43:56.518291 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 141/273] 10.222.0.65 () {60 vars in 1322 bytes} [Fri Jun 24 09:43:56 2022] POST /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef/os-volume_attachments => generated 194 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:43:56.560087 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=6 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:43:57.059066 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-971cc58c-ee5a-4784-8732-149b04c8853b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:57.059066 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-971cc58c-ee5a-4784-8732-149b04c8853b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:57.082338 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-971cc58c-ee5a-4784-8732-149b04c8853b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:57.084015 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-971cc58c-ee5a-4784-8732-149b04c8853b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:57.085182 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-971cc58c-ee5a-4784-8732-149b04c8853b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:57.085878 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-971cc58c-ee5a-4784-8732-149b04c8853b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:57.282325 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-971cc58c-ee5a-4784-8732-149b04c8853b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:57.290921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-971cc58c-ee5a-4784-8732-149b04c8853b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1370 microversion: 2.1 time: 0.237766 Jun 24 09:43:57.291643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 142/274] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:57 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1370 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:58.310726 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-0f402ea3-9a20-426b-a8b7-64b78ed92efc tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:58.313688 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-0f402ea3-9a20-426b-a8b7-64b78ed92efc tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:58.323132 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0f402ea3-9a20-426b-a8b7-64b78ed92efc tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:58.323814 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0f402ea3-9a20-426b-a8b7-64b78ed92efc tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:58.324811 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0f402ea3-9a20-426b-a8b7-64b78ed92efc tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:58.325440 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0f402ea3-9a20-426b-a8b7-64b78ed92efc tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:58.697929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-0f402ea3-9a20-426b-a8b7-64b78ed92efc tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:58.707654 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-0f402ea3-9a20-426b-a8b7-64b78ed92efc tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1370 microversion: 2.1 time: 0.402564 Jun 24 09:43:58.708961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 143/275] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:58 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1370 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:43:59.304704 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-a921a75c-a641-45b2-8c86-86dd91902416 req-4f3a7350-1c5e-4463-a6c3-2cd8acbba53a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64", "name": "network-vif-plugged", "status": "completed", "tag": "604c79af-8cff-4ce1-90d3-2991416e7b7f"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:43:59.314335 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-a921a75c-a641-45b2-8c86-86dd91902416 req-4f3a7350-1c5e-4463-a6c3-2cd8acbba53a service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:59.315030 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-a921a75c-a641-45b2-8c86-86dd91902416 req-4f3a7350-1c5e-4463-a6c3-2cd8acbba53a service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:59.326771 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-a921a75c-a641-45b2-8c86-86dd91902416 req-4f3a7350-1c5e-4463-a6c3-2cd8acbba53a service nova] Creating event network-vif-plugged:604c79af-8cff-4ce1-90d3-2991416e7b7f for instance 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 on hv-cinder-80382 Jun 24 09:43:59.331900 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-a921a75c-a641-45b2-8c86-86dd91902416 req-4f3a7350-1c5e-4463-a6c3-2cd8acbba53a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031099 Jun 24 09:43:59.332836 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 144/276] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:43:59.726886 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-24cd7317-ac2f-4b7c-931e-24a5f4bfecd0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:43:59.728027 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-24cd7317-ac2f-4b7c-931e-24a5f4bfecd0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:43:59.735480 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-24cd7317-ac2f-4b7c-931e-24a5f4bfecd0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:59.735930 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-24cd7317-ac2f-4b7c-931e-24a5f4bfecd0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:59.736688 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-24cd7317-ac2f-4b7c-931e-24a5f4bfecd0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:43:59.737227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-24cd7317-ac2f-4b7c-931e-24a5f4bfecd0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:43:59.873606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-24cd7317-ac2f-4b7c-931e-24a5f4bfecd0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:43:59.884698 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-24cd7317-ac2f-4b7c-931e-24a5f4bfecd0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1370 microversion: 2.1 time: 0.163717 Jun 24 09:43:59.885501 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 145/277] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:43:59 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:00.902390 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-265f1c6e-ce39-4860-bfa4-e967f4a83836 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:00.902991 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-265f1c6e-ce39-4860-bfa4-e967f4a83836 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:00.912744 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-265f1c6e-ce39-4860-bfa4-e967f4a83836 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:00.913615 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-265f1c6e-ce39-4860-bfa4-e967f4a83836 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:00.914817 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-265f1c6e-ce39-4860-bfa4-e967f4a83836 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:00.915573 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-265f1c6e-ce39-4860-bfa4-e967f4a83836 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:01.131358 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-265f1c6e-ce39-4860-bfa4-e967f4a83836 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:01.142115 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-265f1c6e-ce39-4860-bfa4-e967f4a83836 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1370 microversion: 2.1 time: 0.243817 Jun 24 09:44:01.142830 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 146/278] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:00 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:44:02.068747 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-8339fe73-ab19-493b-9a36-e9329743bb82 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "POST /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69/action" status: 202 len: 0 microversion: 2.20 time: 9.925388 Jun 24 09:44:02.069970 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 133/279] 10.222.0.65 () {62 vars in 1318 bytes} [Fri Jun 24 09:43:52 2022] POST /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69/action => generated 0 bytes in 9929 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 24 09:44:02.078232 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-17f19488-eca1-4c04-9d10-64c38cac613a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:02.079025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-17f19488-eca1-4c04-9d10-64c38cac613a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:02.086472 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-17f19488-eca1-4c04-9d10-64c38cac613a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:02.086915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-17f19488-eca1-4c04-9d10-64c38cac613a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:02.088989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-17f19488-eca1-4c04-9d10-64c38cac613a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:02.089615 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-17f19488-eca1-4c04-9d10-64c38cac613a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:02.164485 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-90460060-30b2-4908-a6c6-286c34e1662d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:02.165454 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-90460060-30b2-4908-a6c6-286c34e1662d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:02.171753 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=11 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:44:02.174122 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-90460060-30b2-4908-a6c6-286c34e1662d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:02.174963 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-90460060-30b2-4908-a6c6-286c34e1662d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:02.176228 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-90460060-30b2-4908-a6c6-286c34e1662d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:02.176888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-90460060-30b2-4908-a6c6-286c34e1662d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:02.369356 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-17f19488-eca1-4c04-9d10-64c38cac613a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:02.378801 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-17f19488-eca1-4c04-9d10-64c38cac613a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:02.380378 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-17f19488-eca1-4c04-9d10-64c38cac613a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:02.381575 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-17f19488-eca1-4c04-9d10-64c38cac613a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.307359 Jun 24 09:44:02.382123 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 147/280] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:02 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:02.414340 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-90460060-30b2-4908-a6c6-286c34e1662d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:02.422239 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-90460060-30b2-4908-a6c6-286c34e1662d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1370 microversion: 2.1 time: 0.266371 Jun 24 09:44:02.422819 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 134/281] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:02 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1370 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:03.400513 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4ff9ee74-b564-46cb-82ab-f083e38fd7ef tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:03.401123 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-4ff9ee74-b564-46cb-82ab-f083e38fd7ef tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:03.408084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4ff9ee74-b564-46cb-82ab-f083e38fd7ef tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:03.408534 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4ff9ee74-b564-46cb-82ab-f083e38fd7ef tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:03.409872 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4ff9ee74-b564-46cb-82ab-f083e38fd7ef tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:03.410300 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4ff9ee74-b564-46cb-82ab-f083e38fd7ef tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:03.440171 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-f503037a-4244-4a21-abad-84033f16a935 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:03.440860 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-f503037a-4244-4a21-abad-84033f16a935 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:03.450080 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f503037a-4244-4a21-abad-84033f16a935 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:03.450973 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f503037a-4244-4a21-abad-84033f16a935 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:03.452506 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f503037a-4244-4a21-abad-84033f16a935 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:03.453447 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f503037a-4244-4a21-abad-84033f16a935 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:03.616824 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4ff9ee74-b564-46cb-82ab-f083e38fd7ef tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:03.624927 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4ff9ee74-b564-46cb-82ab-f083e38fd7ef tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:03.626442 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4ff9ee74-b564-46cb-82ab-f083e38fd7ef tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:03.627647 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-4ff9ee74-b564-46cb-82ab-f083e38fd7ef tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.231105 Jun 24 09:44:03.628170 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 148/282] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:03 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:03.643963 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f503037a-4244-4a21-abad-84033f16a935 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:03.651488 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-f503037a-4244-4a21-abad-84033f16a935 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1370 microversion: 2.1 time: 0.215277 Jun 24 09:44:03.652058 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 135/283] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:03 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:44:04.646260 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b6a9a29f-86b1-4e94-8d5c-d0c0e2bae816 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:04.646820 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-b6a9a29f-86b1-4e94-8d5c-d0c0e2bae816 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:04.649254 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:44:04.654733 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b6a9a29f-86b1-4e94-8d5c-d0c0e2bae816 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:04.655199 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b6a9a29f-86b1-4e94-8d5c-d0c0e2bae816 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:04.655954 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b6a9a29f-86b1-4e94-8d5c-d0c0e2bae816 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:04.656377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b6a9a29f-86b1-4e94-8d5c-d0c0e2bae816 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:04.667922 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-34f26684-8fee-4272-9caf-3f58a123a9a5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:04.668867 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-34f26684-8fee-4272-9caf-3f58a123a9a5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:04.676440 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-34f26684-8fee-4272-9caf-3f58a123a9a5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:04.676879 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-34f26684-8fee-4272-9caf-3f58a123a9a5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:04.677671 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-34f26684-8fee-4272-9caf-3f58a123a9a5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:04.678102 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-34f26684-8fee-4272-9caf-3f58a123a9a5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:04.862748 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b6a9a29f-86b1-4e94-8d5c-d0c0e2bae816 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:04.867109 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-34f26684-8fee-4272-9caf-3f58a123a9a5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:04.871035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b6a9a29f-86b1-4e94-8d5c-d0c0e2bae816 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:04.872575 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b6a9a29f-86b1-4e94-8d5c-d0c0e2bae816 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:04.873743 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b6a9a29f-86b1-4e94-8d5c-d0c0e2bae816 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.231655 Jun 24 09:44:04.874304 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 149/284] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:04 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:04.874943 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-34f26684-8fee-4272-9caf-3f58a123a9a5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1370 microversion: 2.1 time: 0.211107 Jun 24 09:44:04.875545 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 136/285] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:04 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:44:05.893186 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-41cfad10-59dd-4fb1-a2c3-9d5d74463d3a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:05.900149 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c80a8ba2-0d53-487b-9de8-c8660d1ff8d4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:05.900917 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-c80a8ba2-0d53-487b-9de8-c8660d1ff8d4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:05.905902 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-41cfad10-59dd-4fb1-a2c3-9d5d74463d3a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:05.915467 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c80a8ba2-0d53-487b-9de8-c8660d1ff8d4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:05.919127 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c80a8ba2-0d53-487b-9de8-c8660d1ff8d4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:05.921379 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-41cfad10-59dd-4fb1-a2c3-9d5d74463d3a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:05.922826 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c80a8ba2-0d53-487b-9de8-c8660d1ff8d4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:05.924811 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c80a8ba2-0d53-487b-9de8-c8660d1ff8d4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:05.931796 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-41cfad10-59dd-4fb1-a2c3-9d5d74463d3a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:05.932933 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-41cfad10-59dd-4fb1-a2c3-9d5d74463d3a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:05.933580 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-41cfad10-59dd-4fb1-a2c3-9d5d74463d3a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:06.241445 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c80a8ba2-0d53-487b-9de8-c8660d1ff8d4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:06.253667 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-c80a8ba2-0d53-487b-9de8-c8660d1ff8d4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1370 microversion: 2.1 time: 0.358649 Jun 24 09:44:06.254746 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 150/286] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:05 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1370 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:06.314204 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-41cfad10-59dd-4fb1-a2c3-9d5d74463d3a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:06.322427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-41cfad10-59dd-4fb1-a2c3-9d5d74463d3a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:06.323935 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-41cfad10-59dd-4fb1-a2c3-9d5d74463d3a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:06.325115 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-41cfad10-59dd-4fb1-a2c3-9d5d74463d3a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.436741 Jun 24 09:44:06.325676 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 137/287] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:05 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:07.274447 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-2ee4ae5d-c224-4586-bf23-97bd3d422f03 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:07.275203 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-2ee4ae5d-c224-4586-bf23-97bd3d422f03 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:07.284405 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2ee4ae5d-c224-4586-bf23-97bd3d422f03 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:07.284847 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2ee4ae5d-c224-4586-bf23-97bd3d422f03 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:07.286785 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2ee4ae5d-c224-4586-bf23-97bd3d422f03 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:07.287533 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2ee4ae5d-c224-4586-bf23-97bd3d422f03 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:07.345528 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-45e6b3a2-3524-46ba-9915-00a07c2cf6f2 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:07.346172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-45e6b3a2-3524-46ba-9915-00a07c2cf6f2 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:07.361857 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-45e6b3a2-3524-46ba-9915-00a07c2cf6f2 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:07.364205 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-45e6b3a2-3524-46ba-9915-00a07c2cf6f2 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:07.365220 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-45e6b3a2-3524-46ba-9915-00a07c2cf6f2 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:07.365948 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-45e6b3a2-3524-46ba-9915-00a07c2cf6f2 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:07.684206 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-45e6b3a2-3524-46ba-9915-00a07c2cf6f2 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:07.696523 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-2ee4ae5d-c224-4586-bf23-97bd3d422f03 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:07.705158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-45e6b3a2-3524-46ba-9915-00a07c2cf6f2 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:07.706939 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-2ee4ae5d-c224-4586-bf23-97bd3d422f03 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1563 microversion: 2.1 time: 0.436537 Jun 24 09:44:07.708106 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 151/288] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:07 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1563 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:07.709250 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-45e6b3a2-3524-46ba-9915-00a07c2cf6f2 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:07.710744 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-45e6b3a2-3524-46ba-9915-00a07c2cf6f2 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.369613 Jun 24 09:44:07.711435 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 138/289] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:07 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:44:07.730973 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-94db6e75-707b-496c-bd25-f8d951265744 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:07.732642 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-94db6e75-707b-496c-bd25-f8d951265744 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:07.757522 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-94db6e75-707b-496c-bd25-f8d951265744 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:07.766916 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-94db6e75-707b-496c-bd25-f8d951265744 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:07.769576 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-94db6e75-707b-496c-bd25-f8d951265744 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:07.770799 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-94db6e75-707b-496c-bd25-f8d951265744 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:07.901002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-94db6e75-707b-496c-bd25-f8d951265744 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180288 Jun 24 09:44:07.908130 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 152/290] 10.222.0.65 () {58 vars in 1274 bytes} [Fri Jun 24 09:44:07 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/os-interface => generated 284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:44:08.545170 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-d873c8b7-b9e4-4979-87e6-676220904b45 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Action: 'create', calling method: .version_select at 0x7fc6d4f51f70>, body: {"keypair": {"name": "tempest-keypair-1891383858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIO5A7LuXzdIadUL9An20+YrOJHobrWLDACy2HROk9J1y9GLDn4UUjw4Qq0INn+ygYYUmLXbIaZOmaueqqD8lK5iXgFwijmDeeHmkEq496ULtWrQIKloSjNRAqZEn2ZTEw=="}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:44:08.561400 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-d873c8b7-b9e4-4979-87e6-676220904b45 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Getting quotas for project 30033ce42b5a43b78dde38163831cea2. Resources: {'key_pairs'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:44:08.580838 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-d873c8b7-b9e4-4979-87e6-676220904b45 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Getting quotas for user fd136fcda9a04a16b258301a86bde8ef and project 30033ce42b5a43b78dde38163831cea2. Resources: {'key_pairs'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:44:08.621125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-d873c8b7-b9e4-4979-87e6-676220904b45 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.079897 Jun 24 09:44:08.622316 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 139/291] 10.222.0.65 () {60 vars in 1158 bytes} [Fri Jun 24 09:44:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:44:08.743417 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-d8e6536f-e757-4141-ae4b-75c76b1d5241 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:08.745852 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-d8e6536f-e757-4141-ae4b-75c76b1d5241 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:08.777797 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d8e6536f-e757-4141-ae4b-75c76b1d5241 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:08.782100 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d8e6536f-e757-4141-ae4b-75c76b1d5241 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:08.788519 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d8e6536f-e757-4141-ae4b-75c76b1d5241 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:08.790309 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d8e6536f-e757-4141-ae4b-75c76b1d5241 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:08.834681 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:44:09.198308 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-d8e6536f-e757-4141-ae4b-75c76b1d5241 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:09.226470 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-d8e6536f-e757-4141-ae4b-75c76b1d5241 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:09.237496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-d8e6536f-e757-4141-ae4b-75c76b1d5241 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:09.239948 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-d8e6536f-e757-4141-ae4b-75c76b1d5241 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.507004 Jun 24 09:44:09.255582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 153/292] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:08 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:09.862775 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-6baf23fe-19b6-49d3-b254-510d8039f323 req-ca2c2b8a-bfc7-46e9-ab46-143a9b3fe6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64", "tag": "604c79af-8cff-4ce1-90d3-2991416e7b7f"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:44:09.905057 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-6baf23fe-19b6-49d3-b254-510d8039f323 req-ca2c2b8a-bfc7-46e9-ab46-143a9b3fe6e7 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:09.909679 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-6baf23fe-19b6-49d3-b254-510d8039f323 req-ca2c2b8a-bfc7-46e9-ab46-143a9b3fe6e7 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:09.959480 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-6baf23fe-19b6-49d3-b254-510d8039f323 req-ca2c2b8a-bfc7-46e9-ab46-143a9b3fe6e7 service nova] Creating event network-changed:604c79af-8cff-4ce1-90d3-2991416e7b7f for instance 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 on hv-cinder-80382 Jun 24 09:44:09.983499 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-6baf23fe-19b6-49d3-b254-510d8039f323 req-ca2c2b8a-bfc7-46e9-ab46-143a9b3fe6e7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129109 Jun 24 09:44:09.994075 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 140/293] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:44:10.269446 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c203543c-91e1-42ed-937d-c0759da0244f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:10.270056 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-c203543c-91e1-42ed-937d-c0759da0244f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:10.282620 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c203543c-91e1-42ed-937d-c0759da0244f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:10.283060 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c203543c-91e1-42ed-937d-c0759da0244f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:10.302740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c203543c-91e1-42ed-937d-c0759da0244f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:10.303231 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c203543c-91e1-42ed-937d-c0759da0244f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:10.543749 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c203543c-91e1-42ed-937d-c0759da0244f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:10.563396 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c203543c-91e1-42ed-937d-c0759da0244f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:10.569385 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c203543c-91e1-42ed-937d-c0759da0244f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:10.572861 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-c203543c-91e1-42ed-937d-c0759da0244f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.307455 Jun 24 09:44:10.573740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 154/294] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:10 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:11.178401 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-c981d6b6-2de0-4ffa-8a55-50913aad22f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-272801396", "imageRef": "844ad823-18a2-4abc-813c-2d1825141591", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6d825bf-3025-4144-aa4c-5693ec78fffa"}], "security_groups": [{"name": "tempest-securitygroup--1554424275"}], "key_name": "tempest-keypair-1891383858", "user_data": "}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:44:11.294757 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.network.neutron [None req-c981d6b6-2de0-4ffa-8a55-50913aad22f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] validate_networks() for [('d6d825bf-3025-4144-aa4c-5693ec78fffa', None, None, None, None, None)] {{(pid=124338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:44:11.618844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e67b7d21-79be-4ee2-a59f-5cfbf8833866 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:11.620288 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e67b7d21-79be-4ee2-a59f-5cfbf8833866 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:11.644405 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e67b7d21-79be-4ee2-a59f-5cfbf8833866 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:11.645316 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e67b7d21-79be-4ee2-a59f-5cfbf8833866 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:11.646659 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e67b7d21-79be-4ee2-a59f-5cfbf8833866 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:11.647595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e67b7d21-79be-4ee2-a59f-5cfbf8833866 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:11.787386 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-c981d6b6-2de0-4ffa-8a55-50913aad22f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Flavor limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:44:11.788744 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-c981d6b6-2de0-4ffa-8a55-50913aad22f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Image limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:44:11.789377 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-c981d6b6-2de0-4ffa-8a55-50913aad22f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Flavor pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:44:11.790048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-c981d6b6-2de0-4ffa-8a55-50913aad22f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Image pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:44:11.790635 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-c981d6b6-2de0-4ffa-8a55-50913aad22f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:44:11.801352 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c981d6b6-2de0-4ffa-8a55-50913aad22f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:11.802038 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c981d6b6-2de0-4ffa-8a55-50913aad22f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:11.802833 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c981d6b6-2de0-4ffa-8a55-50913aad22f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:11.803287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c981d6b6-2de0-4ffa-8a55-50913aad22f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:11.821045 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-c981d6b6-2de0-4ffa-8a55-50913aad22f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Getting quotas for project 30033ce42b5a43b78dde38163831cea2. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:44:11.825251 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-c981d6b6-2de0-4ffa-8a55-50913aad22f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Getting quotas for user fd136fcda9a04a16b258301a86bde8ef and project 30033ce42b5a43b78dde38163831cea2. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:44:11.837554 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-c981d6b6-2de0-4ffa-8a55-50913aad22f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Going to run 1 instances... {{(pid=124338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:44:11.839980 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-c981d6b6-2de0-4ffa-8a55-50913aad22f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='844ad823-18a2-4abc-813c-2d1825141591',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:44:11.848426 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e67b7d21-79be-4ee2-a59f-5cfbf8833866 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:11.857054 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e67b7d21-79be-4ee2-a59f-5cfbf8833866 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:11.858554 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e67b7d21-79be-4ee2-a59f-5cfbf8833866 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:11.859744 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e67b7d21-79be-4ee2-a59f-5cfbf8833866 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.253088 Jun 24 09:44:11.860297 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 155/295] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:11 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:11.889943 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-c981d6b6-2de0-4ffa-8a55-50913aad22f1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.716299 Jun 24 09:44:11.890588 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 141/296] 10.222.0.65 () {60 vars in 1146 bytes} [Fri Jun 24 09:44:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 09:44:11.901924 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-14b9d843-3081-48c1-990d-969a4bfa17b2 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:11.902882 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-14b9d843-3081-48c1-990d-969a4bfa17b2 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:11.962445 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-14b9d843-3081-48c1-990d-969a4bfa17b2 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:11.969673 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-14b9d843-3081-48c1-990d-969a4bfa17b2 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1241 microversion: 2.1 time: 0.072236 Jun 24 09:44:11.970588 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 156/297] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:11 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:12.890565 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-5051aeaf-df5f-448b-b881-d12223528840 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:12.892842 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-5051aeaf-df5f-448b-b881-d12223528840 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:12.935815 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5051aeaf-df5f-448b-b881-d12223528840 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:12.936261 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5051aeaf-df5f-448b-b881-d12223528840 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:12.937303 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5051aeaf-df5f-448b-b881-d12223528840 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:12.939177 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5051aeaf-df5f-448b-b881-d12223528840 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:12.998667 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-bcf84b3f-4a2d-4c48-a4bc-0a55c4ffd6b4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:12.998667 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-bcf84b3f-4a2d-4c48-a4bc-0a55c4ffd6b4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:13.021045 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bcf84b3f-4a2d-4c48-a4bc-0a55c4ffd6b4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:13.022278 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bcf84b3f-4a2d-4c48-a4bc-0a55c4ffd6b4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:13.036090 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bcf84b3f-4a2d-4c48-a4bc-0a55c4ffd6b4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:13.037025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bcf84b3f-4a2d-4c48-a4bc-0a55c4ffd6b4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:13.184666 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-bcf84b3f-4a2d-4c48-a4bc-0a55c4ffd6b4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:13.214299 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-bcf84b3f-4a2d-4c48-a4bc-0a55c4ffd6b4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1293 microversion: 2.1 time: 0.229186 Jun 24 09:44:13.219473 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 157/298] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:12 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1293 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:13.340996 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-5051aeaf-df5f-448b-b881-d12223528840 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:13.352132 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-5051aeaf-df5f-448b-b881-d12223528840 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:13.353999 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-5051aeaf-df5f-448b-b881-d12223528840 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:13.357197 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-5051aeaf-df5f-448b-b881-d12223528840 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.472842 Jun 24 09:44:13.371459 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 142/299] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:12 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:14.246137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f19ff422-2bc0-47d0-bb7f-86ccca9b515f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:14.248243 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-f19ff422-2bc0-47d0-bb7f-86ccca9b515f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:14.264355 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f19ff422-2bc0-47d0-bb7f-86ccca9b515f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:14.266852 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f19ff422-2bc0-47d0-bb7f-86ccca9b515f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:14.274588 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f19ff422-2bc0-47d0-bb7f-86ccca9b515f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:14.275435 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f19ff422-2bc0-47d0-bb7f-86ccca9b515f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:14.380806 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-d3b430c1-ae36-4293-a403-db0df3678725 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:14.382154 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-d3b430c1-ae36-4293-a403-db0df3678725 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:14.457654 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d3b430c1-ae36-4293-a403-db0df3678725 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:14.457967 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-f19ff422-2bc0-47d0-bb7f-86ccca9b515f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:14.459107 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d3b430c1-ae36-4293-a403-db0df3678725 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:14.460277 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d3b430c1-ae36-4293-a403-db0df3678725 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:14.460726 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d3b430c1-ae36-4293-a403-db0df3678725 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:14.486617 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f19ff422-2bc0-47d0-bb7f-86ccca9b515f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1299 microversion: 2.1 time: 0.243261 Jun 24 09:44:14.506086 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 158/300] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:14 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1299 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:44:14.839845 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d3b430c1-ae36-4293-a403-db0df3678725 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:14.853029 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d3b430c1-ae36-4293-a403-db0df3678725 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:14.855300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d3b430c1-ae36-4293-a403-db0df3678725 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:14.857372 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-d3b430c1-ae36-4293-a403-db0df3678725 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.481334 Jun 24 09:44:14.858497 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 143/301] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:14 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:44:15.152217 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4f81b4c3-87d1-4122-a5b2-e9e5cddfc645 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cc44ed1-3c40-40b9-a209-5d55b8c60d8f", "device": "/dev/sdb"}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:44:15.155004 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-4f81b4c3-87d1-4122-a5b2-e9e5cddfc645 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:15.195482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4f81b4c3-87d1-4122-a5b2-e9e5cddfc645 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:15.196590 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4f81b4c3-87d1-4122-a5b2-e9e5cddfc645 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:15.199281 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4f81b4c3-87d1-4122-a5b2-e9e5cddfc645 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:15.199281 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4f81b4c3-87d1-4122-a5b2-e9e5cddfc645 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:15.523265 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-997a0cec-2692-4409-a9f8-166fee3d5354 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:15.527491 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-997a0cec-2692-4409-a9f8-166fee3d5354 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:15.546045 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-997a0cec-2692-4409-a9f8-166fee3d5354 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:15.547673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-997a0cec-2692-4409-a9f8-166fee3d5354 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:15.548839 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-997a0cec-2692-4409-a9f8-166fee3d5354 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:15.549617 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-997a0cec-2692-4409-a9f8-166fee3d5354 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:15.756385 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-997a0cec-2692-4409-a9f8-166fee3d5354 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:15.781526 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-997a0cec-2692-4409-a9f8-166fee3d5354 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1367 microversion: 2.1 time: 0.270469 Jun 24 09:44:15.786579 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 144/302] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:15 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:15.880560 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-2654d653-cde6-4b08-b0fb-6e06e1c2a759 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:15.881505 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-2654d653-cde6-4b08-b0fb-6e06e1c2a759 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:15.889010 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2654d653-cde6-4b08-b0fb-6e06e1c2a759 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:15.889454 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2654d653-cde6-4b08-b0fb-6e06e1c2a759 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:15.890528 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2654d653-cde6-4b08-b0fb-6e06e1c2a759 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:15.891153 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2654d653-cde6-4b08-b0fb-6e06e1c2a759 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:16.134129 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-2654d653-cde6-4b08-b0fb-6e06e1c2a759 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:16.142964 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-2654d653-cde6-4b08-b0fb-6e06e1c2a759 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:16.144611 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-2654d653-cde6-4b08-b0fb-6e06e1c2a759 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:16.145797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-2654d653-cde6-4b08-b0fb-6e06e1c2a759 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.273062 Jun 24 09:44:16.146357 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 145/303] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:15 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:44:16.801115 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-79afc40f-4339-41cd-8218-f47f8e4d5eb8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:16.803062 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-79afc40f-4339-41cd-8218-f47f8e4d5eb8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:16.812719 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-79afc40f-4339-41cd-8218-f47f8e4d5eb8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:16.813452 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-79afc40f-4339-41cd-8218-f47f8e4d5eb8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:16.814391 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-79afc40f-4339-41cd-8218-f47f8e4d5eb8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:16.814832 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-79afc40f-4339-41cd-8218-f47f8e4d5eb8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:17.008183 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-79afc40f-4339-41cd-8218-f47f8e4d5eb8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:17.022198 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-79afc40f-4339-41cd-8218-f47f8e4d5eb8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1367 microversion: 2.1 time: 0.226602 Jun 24 09:44:17.023929 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 146/304] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:16 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:17.178554 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-100b3053-4c03-4b2d-96b6-d833ffd4cff7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:17.179637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-100b3053-4c03-4b2d-96b6-d833ffd4cff7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:17.189991 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-100b3053-4c03-4b2d-96b6-d833ffd4cff7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:17.190712 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-100b3053-4c03-4b2d-96b6-d833ffd4cff7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:17.192026 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-100b3053-4c03-4b2d-96b6-d833ffd4cff7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:17.192733 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-100b3053-4c03-4b2d-96b6-d833ffd4cff7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:17.227011 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:44:17.416742 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-100b3053-4c03-4b2d-96b6-d833ffd4cff7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:17.425549 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-100b3053-4c03-4b2d-96b6-d833ffd4cff7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:17.427100 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-100b3053-4c03-4b2d-96b6-d833ffd4cff7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:17.439049 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-100b3053-4c03-4b2d-96b6-d833ffd4cff7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.256140 Jun 24 09:44:17.439049 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 147/305] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:17 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:44:17.774862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-4f81b4c3-87d1-4122-a5b2-e9e5cddfc645 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "POST /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.637555 Jun 24 09:44:17.776463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 159/306] 10.222.0.65 () {60 vars in 1322 bytes} [Fri Jun 24 09:44:15 2022] POST /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca/os-volume_attachments => generated 194 bytes in 2642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:44:18.054663 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-b6334619-5ecd-40c8-8127-8fc68cbd0508 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:18.057930 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-b6334619-5ecd-40c8-8127-8fc68cbd0508 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:18.070163 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b6334619-5ecd-40c8-8127-8fc68cbd0508 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:18.070826 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b6334619-5ecd-40c8-8127-8fc68cbd0508 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:18.072346 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b6334619-5ecd-40c8-8127-8fc68cbd0508 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:18.072822 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b6334619-5ecd-40c8-8127-8fc68cbd0508 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:18.342136 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-b6334619-5ecd-40c8-8127-8fc68cbd0508 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:18.361543 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-b6334619-5ecd-40c8-8127-8fc68cbd0508 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1367 microversion: 2.1 time: 0.319507 Jun 24 09:44:18.362337 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 148/307] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:18 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:18.431624 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-d3ebd8b7-d029-47cc-8bf5-cf825b35a631 req-e60f4fcc-849b-41fd-811d-51a36db1e656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67719189-e3da-4e2f-99cd-a136ece74789", "tag": "a8a8d8ec-532a-4f39-a19c-dd244aecac18"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:44:18.449961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-d3ebd8b7-d029-47cc-8bf5-cf825b35a631 req-e60f4fcc-849b-41fd-811d-51a36db1e656 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:18.451222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-6ffb4ec0-3f8c-4f70-8051-82ed46990304 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:18.452288 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-6ffb4ec0-3f8c-4f70-8051-82ed46990304 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:18.452948 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-d3ebd8b7-d029-47cc-8bf5-cf825b35a631 req-e60f4fcc-849b-41fd-811d-51a36db1e656 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:18.464448 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6ffb4ec0-3f8c-4f70-8051-82ed46990304 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:18.465911 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6ffb4ec0-3f8c-4f70-8051-82ed46990304 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:18.467873 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6ffb4ec0-3f8c-4f70-8051-82ed46990304 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:18.468536 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6ffb4ec0-3f8c-4f70-8051-82ed46990304 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:18.489644 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-d3ebd8b7-d029-47cc-8bf5-cf825b35a631 req-e60f4fcc-849b-41fd-811d-51a36db1e656 service nova] Creating event network-changed:a8a8d8ec-532a-4f39-a19c-dd244aecac18 for instance 67719189-e3da-4e2f-99cd-a136ece74789 on hv-cinder-80382 Jun 24 09:44:18.495286 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-d3ebd8b7-d029-47cc-8bf5-cf825b35a631 req-e60f4fcc-849b-41fd-811d-51a36db1e656 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068696 Jun 24 09:44:18.498765 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 160/308] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:44:18.725768 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-6ffb4ec0-3f8c-4f70-8051-82ed46990304 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:18.738094 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-6ffb4ec0-3f8c-4f70-8051-82ed46990304 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:18.739903 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-6ffb4ec0-3f8c-4f70-8051-82ed46990304 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:18.745841 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-6ffb4ec0-3f8c-4f70-8051-82ed46990304 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.301787 Jun 24 09:44:18.763115 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 149/309] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:18 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:19.383259 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c59c0ade-eeca-4eb4-886b-8c85029f67e0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:19.384547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-c59c0ade-eeca-4eb4-886b-8c85029f67e0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:19.396533 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c59c0ade-eeca-4eb4-886b-8c85029f67e0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:19.397478 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c59c0ade-eeca-4eb4-886b-8c85029f67e0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:19.398866 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c59c0ade-eeca-4eb4-886b-8c85029f67e0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:19.399710 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c59c0ade-eeca-4eb4-886b-8c85029f67e0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:19.625018 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c59c0ade-eeca-4eb4-886b-8c85029f67e0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:19.636896 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-c59c0ade-eeca-4eb4-886b-8c85029f67e0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1367 microversion: 2.1 time: 0.261693 Jun 24 09:44:19.651720 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 161/310] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:19 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:19.782461 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-f607d1f3-7488-4d16-8573-73d8ff843dd1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:19.784591 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-f607d1f3-7488-4d16-8573-73d8ff843dd1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:19.795489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f607d1f3-7488-4d16-8573-73d8ff843dd1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:19.796234 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f607d1f3-7488-4d16-8573-73d8ff843dd1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:19.797815 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f607d1f3-7488-4d16-8573-73d8ff843dd1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:19.798878 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f607d1f3-7488-4d16-8573-73d8ff843dd1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:20.069489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f607d1f3-7488-4d16-8573-73d8ff843dd1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:20.084216 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f607d1f3-7488-4d16-8573-73d8ff843dd1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:20.087941 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f607d1f3-7488-4d16-8573-73d8ff843dd1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:20.090778 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-f607d1f3-7488-4d16-8573-73d8ff843dd1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.314727 Jun 24 09:44:20.102904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 150/311] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:19 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:44:20.665253 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-95e8e4bd-52aa-46ad-8ee1-baaebfb62090 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:20.665253 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-95e8e4bd-52aa-46ad-8ee1-baaebfb62090 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:20.668127 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-95e8e4bd-52aa-46ad-8ee1-baaebfb62090 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:20.668921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-95e8e4bd-52aa-46ad-8ee1-baaebfb62090 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:20.669850 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-95e8e4bd-52aa-46ad-8ee1-baaebfb62090 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:20.670464 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-95e8e4bd-52aa-46ad-8ee1-baaebfb62090 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:20.893556 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-95e8e4bd-52aa-46ad-8ee1-baaebfb62090 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:20.902943 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-95e8e4bd-52aa-46ad-8ee1-baaebfb62090 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1367 microversion: 2.1 time: 0.246476 Jun 24 09:44:20.903561 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 162/312] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:20 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:44:21.114548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ebdb5b40-c8e0-490d-ad3d-e5fa94673171 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:21.116621 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ebdb5b40-c8e0-490d-ad3d-e5fa94673171 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:21.135423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ebdb5b40-c8e0-490d-ad3d-e5fa94673171 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:21.136361 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ebdb5b40-c8e0-490d-ad3d-e5fa94673171 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:21.137921 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ebdb5b40-c8e0-490d-ad3d-e5fa94673171 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:21.138764 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ebdb5b40-c8e0-490d-ad3d-e5fa94673171 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:21.344923 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ebdb5b40-c8e0-490d-ad3d-e5fa94673171 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:21.359285 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ebdb5b40-c8e0-490d-ad3d-e5fa94673171 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:21.362843 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ebdb5b40-c8e0-490d-ad3d-e5fa94673171 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:21.365126 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ebdb5b40-c8e0-490d-ad3d-e5fa94673171 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.258110 Jun 24 09:44:21.366671 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 151/313] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:21 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:21.920071 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e75fe3cd-5dc7-4cac-8846-fa959fd9e091 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:21.920843 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e75fe3cd-5dc7-4cac-8846-fa959fd9e091 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:21.927624 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e75fe3cd-5dc7-4cac-8846-fa959fd9e091 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:21.928087 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e75fe3cd-5dc7-4cac-8846-fa959fd9e091 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:21.929077 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e75fe3cd-5dc7-4cac-8846-fa959fd9e091 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:21.929497 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e75fe3cd-5dc7-4cac-8846-fa959fd9e091 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:21.966990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=2 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:44:22.086679 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e75fe3cd-5dc7-4cac-8846-fa959fd9e091 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:22.095771 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e75fe3cd-5dc7-4cac-8846-fa959fd9e091 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1367 microversion: 2.1 time: 0.179053 Jun 24 09:44:22.096141 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 163/314] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:21 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:22.380794 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=2 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:44:22.382421 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=10 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:44:22.388512 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-6a953f48-cba8-472e-9e1f-f3c30c0dce61 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:22.389144 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-6a953f48-cba8-472e-9e1f-f3c30c0dce61 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:22.397006 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6a953f48-cba8-472e-9e1f-f3c30c0dce61 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:22.397448 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6a953f48-cba8-472e-9e1f-f3c30c0dce61 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:22.398248 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6a953f48-cba8-472e-9e1f-f3c30c0dce61 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:22.398679 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6a953f48-cba8-472e-9e1f-f3c30c0dce61 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:22.554754 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-6a953f48-cba8-472e-9e1f-f3c30c0dce61 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:22.567801 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-6a953f48-cba8-472e-9e1f-f3c30c0dce61 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:22.570256 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-6a953f48-cba8-472e-9e1f-f3c30c0dce61 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:22.572094 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-6a953f48-cba8-472e-9e1f-f3c30c0dce61 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.192100 Jun 24 09:44:22.572923 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 152/315] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:22 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:23.114649 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-91d22e7f-1271-4dfc-a80c-6443c0ca18e1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:23.115266 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-91d22e7f-1271-4dfc-a80c-6443c0ca18e1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:23.122937 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-91d22e7f-1271-4dfc-a80c-6443c0ca18e1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:23.122937 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-91d22e7f-1271-4dfc-a80c-6443c0ca18e1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:23.123517 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-91d22e7f-1271-4dfc-a80c-6443c0ca18e1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:23.123945 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-91d22e7f-1271-4dfc-a80c-6443c0ca18e1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:23.279147 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-91d22e7f-1271-4dfc-a80c-6443c0ca18e1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:23.291429 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-91d22e7f-1271-4dfc-a80c-6443c0ca18e1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1367 microversion: 2.1 time: 0.181049 Jun 24 09:44:23.296404 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 164/316] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:23 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:23.599019 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-a7925b4a-10c5-4033-a746-6f1cfe3e7baf tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:23.599764 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-a7925b4a-10c5-4033-a746-6f1cfe3e7baf tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:23.607998 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a7925b4a-10c5-4033-a746-6f1cfe3e7baf tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:23.608444 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a7925b4a-10c5-4033-a746-6f1cfe3e7baf tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:23.609216 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a7925b4a-10c5-4033-a746-6f1cfe3e7baf tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:23.609644 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a7925b4a-10c5-4033-a746-6f1cfe3e7baf tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:23.754950 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-a7925b4a-10c5-4033-a746-6f1cfe3e7baf tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:23.763500 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-a7925b4a-10c5-4033-a746-6f1cfe3e7baf tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:23.765021 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-a7925b4a-10c5-4033-a746-6f1cfe3e7baf tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:23.766270 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-a7925b4a-10c5-4033-a746-6f1cfe3e7baf tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.172530 Jun 24 09:44:23.766881 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 153/317] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:23 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:24.312922 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4898f1bf-a7ad-4d56-96b9-2f9719165822 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:24.314416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-4898f1bf-a7ad-4d56-96b9-2f9719165822 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:24.322790 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4898f1bf-a7ad-4d56-96b9-2f9719165822 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:24.323626 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4898f1bf-a7ad-4d56-96b9-2f9719165822 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:24.325043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4898f1bf-a7ad-4d56-96b9-2f9719165822 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:24.325620 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4898f1bf-a7ad-4d56-96b9-2f9719165822 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:24.496842 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4898f1bf-a7ad-4d56-96b9-2f9719165822 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:24.508099 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-4898f1bf-a7ad-4d56-96b9-2f9719165822 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1367 microversion: 2.1 time: 0.200188 Jun 24 09:44:24.509205 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 165/318] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:24 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:44:24.786833 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-80e27b56-6b8b-4b5c-9358-f9a8204d599c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:24.787544 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-80e27b56-6b8b-4b5c-9358-f9a8204d599c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:24.794343 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-80e27b56-6b8b-4b5c-9358-f9a8204d599c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:24.794789 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-80e27b56-6b8b-4b5c-9358-f9a8204d599c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:24.795594 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-80e27b56-6b8b-4b5c-9358-f9a8204d599c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:24.796088 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-80e27b56-6b8b-4b5c-9358-f9a8204d599c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:24.951216 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-80e27b56-6b8b-4b5c-9358-f9a8204d599c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:24.961737 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-80e27b56-6b8b-4b5c-9358-f9a8204d599c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:24.963913 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-80e27b56-6b8b-4b5c-9358-f9a8204d599c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:24.965455 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-80e27b56-6b8b-4b5c-9358-f9a8204d599c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.182861 Jun 24 09:44:24.966071 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 154/319] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:24 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:25.527717 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-ef4cd2d3-f217-45ca-92e6-a24e0d6dacb4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:25.528940 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-ef4cd2d3-f217-45ca-92e6-a24e0d6dacb4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:25.535932 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ef4cd2d3-f217-45ca-92e6-a24e0d6dacb4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:25.536386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ef4cd2d3-f217-45ca-92e6-a24e0d6dacb4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:25.537187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ef4cd2d3-f217-45ca-92e6-a24e0d6dacb4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:25.537616 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ef4cd2d3-f217-45ca-92e6-a24e0d6dacb4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:25.702514 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ef4cd2d3-f217-45ca-92e6-a24e0d6dacb4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:25.711275 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-ef4cd2d3-f217-45ca-92e6-a24e0d6dacb4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1367 microversion: 2.1 time: 0.187791 Jun 24 09:44:25.711943 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 166/320] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:25 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:25.989587 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-c824b713-c758-42b9-af8b-324f6cd87ede tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:25.990451 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-c824b713-c758-42b9-af8b-324f6cd87ede tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:25.996761 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c824b713-c758-42b9-af8b-324f6cd87ede tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:25.997256 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c824b713-c758-42b9-af8b-324f6cd87ede tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:25.997980 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c824b713-c758-42b9-af8b-324f6cd87ede tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:25.998415 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c824b713-c758-42b9-af8b-324f6cd87ede tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:26.179414 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-c824b713-c758-42b9-af8b-324f6cd87ede tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:26.188004 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-c824b713-c758-42b9-af8b-324f6cd87ede tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:26.189952 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-c824b713-c758-42b9-af8b-324f6cd87ede tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:26.191191 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-c824b713-c758-42b9-af8b-324f6cd87ede tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.205656 Jun 24 09:44:26.191743 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 155/321] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:25 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:26.729994 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-ef2ea560-9aa1-463b-832f-5f0529c04564 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:26.730597 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-ef2ea560-9aa1-463b-832f-5f0529c04564 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:26.738118 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ef2ea560-9aa1-463b-832f-5f0529c04564 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:26.738560 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ef2ea560-9aa1-463b-832f-5f0529c04564 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:26.739375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ef2ea560-9aa1-463b-832f-5f0529c04564 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:26.739805 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ef2ea560-9aa1-463b-832f-5f0529c04564 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:26.882898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ef2ea560-9aa1-463b-832f-5f0529c04564 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:26.890639 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-ef2ea560-9aa1-463b-832f-5f0529c04564 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1367 microversion: 2.1 time: 0.165025 Jun 24 09:44:26.891238 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 167/322] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:26 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:27.209929 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-2d56bb9a-4477-41a1-a2d1-06f25ee184a9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:27.210527 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-2d56bb9a-4477-41a1-a2d1-06f25ee184a9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:27.217797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2d56bb9a-4477-41a1-a2d1-06f25ee184a9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:27.218245 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2d56bb9a-4477-41a1-a2d1-06f25ee184a9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:27.219009 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2d56bb9a-4477-41a1-a2d1-06f25ee184a9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:27.219454 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2d56bb9a-4477-41a1-a2d1-06f25ee184a9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:27.376327 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-2d56bb9a-4477-41a1-a2d1-06f25ee184a9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:27.388707 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-2d56bb9a-4477-41a1-a2d1-06f25ee184a9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:27.390358 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-2d56bb9a-4477-41a1-a2d1-06f25ee184a9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:27.391581 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-2d56bb9a-4477-41a1-a2d1-06f25ee184a9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.185696 Jun 24 09:44:27.392156 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 156/323] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:27 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:27.908998 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-be198c83-444a-4ed7-b4ed-2954a55872ab tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:27.909643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-be198c83-444a-4ed7-b4ed-2954a55872ab tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:27.916791 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-be198c83-444a-4ed7-b4ed-2954a55872ab tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:27.917236 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-be198c83-444a-4ed7-b4ed-2954a55872ab tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:27.918004 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-be198c83-444a-4ed7-b4ed-2954a55872ab tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:27.918543 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-be198c83-444a-4ed7-b4ed-2954a55872ab tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:28.066117 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-be198c83-444a-4ed7-b4ed-2954a55872ab tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:28.075105 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-be198c83-444a-4ed7-b4ed-2954a55872ab tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1367 microversion: 2.1 time: 0.170236 Jun 24 09:44:28.075718 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 168/324] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:27 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:28.418165 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-aab579d9-ef02-4f36-af4c-5deae8cc4de4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:28.418165 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-aab579d9-ef02-4f36-af4c-5deae8cc4de4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:28.430657 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-aab579d9-ef02-4f36-af4c-5deae8cc4de4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:28.431128 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-aab579d9-ef02-4f36-af4c-5deae8cc4de4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:28.432081 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-aab579d9-ef02-4f36-af4c-5deae8cc4de4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:28.432581 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-aab579d9-ef02-4f36-af4c-5deae8cc4de4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:28.620599 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-aab579d9-ef02-4f36-af4c-5deae8cc4de4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:28.631418 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-aab579d9-ef02-4f36-af4c-5deae8cc4de4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:28.632941 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-aab579d9-ef02-4f36-af4c-5deae8cc4de4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:28.634152 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-aab579d9-ef02-4f36-af4c-5deae8cc4de4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.223312 Jun 24 09:44:28.634713 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 157/325] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:28 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:44:29.096608 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3be0018a-d23a-4d81-bcc8-4802a86ca514 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:29.097345 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3be0018a-d23a-4d81-bcc8-4802a86ca514 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:29.104589 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3be0018a-d23a-4d81-bcc8-4802a86ca514 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:29.105080 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3be0018a-d23a-4d81-bcc8-4802a86ca514 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:29.105886 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3be0018a-d23a-4d81-bcc8-4802a86ca514 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:29.106428 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3be0018a-d23a-4d81-bcc8-4802a86ca514 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:29.244112 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3be0018a-d23a-4d81-bcc8-4802a86ca514 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:29.253014 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3be0018a-d23a-4d81-bcc8-4802a86ca514 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1367 microversion: 2.1 time: 0.160756 Jun 24 09:44:29.253754 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 169/326] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:29 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:29.655805 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-6fbf6cba-7b09-4642-bd2c-ac62ce2c1731 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:29.656984 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-6fbf6cba-7b09-4642-bd2c-ac62ce2c1731 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:29.670552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6fbf6cba-7b09-4642-bd2c-ac62ce2c1731 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:29.671221 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6fbf6cba-7b09-4642-bd2c-ac62ce2c1731 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:29.672217 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6fbf6cba-7b09-4642-bd2c-ac62ce2c1731 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:29.672772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6fbf6cba-7b09-4642-bd2c-ac62ce2c1731 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:29.910599 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-6fbf6cba-7b09-4642-bd2c-ac62ce2c1731 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:29.922641 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-6fbf6cba-7b09-4642-bd2c-ac62ce2c1731 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:29.925613 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-6fbf6cba-7b09-4642-bd2c-ac62ce2c1731 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:29.927729 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-6fbf6cba-7b09-4642-bd2c-ac62ce2c1731 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.277486 Jun 24 09:44:29.928419 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 158/327] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:29 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:30.270869 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-bfa295b9-e0c8-45d5-b547-9792bed4f929 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:30.271911 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-bfa295b9-e0c8-45d5-b547-9792bed4f929 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:30.279914 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bfa295b9-e0c8-45d5-b547-9792bed4f929 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:30.280494 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bfa295b9-e0c8-45d5-b547-9792bed4f929 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:30.281526 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bfa295b9-e0c8-45d5-b547-9792bed4f929 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:30.282203 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bfa295b9-e0c8-45d5-b547-9792bed4f929 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:30.307437 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:44:30.446664 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-bfa295b9-e0c8-45d5-b547-9792bed4f929 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:30.457679 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-bfa295b9-e0c8-45d5-b547-9792bed4f929 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1367 microversion: 2.1 time: 0.191178 Jun 24 09:44:30.458534 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 170/328] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:30 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:30.948616 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-796985aa-7f62-4486-b113-429d9b54a2ac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:30.949224 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-796985aa-7f62-4486-b113-429d9b54a2ac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:30.956224 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-796985aa-7f62-4486-b113-429d9b54a2ac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:30.956701 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-796985aa-7f62-4486-b113-429d9b54a2ac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:30.957472 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-796985aa-7f62-4486-b113-429d9b54a2ac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:30.957905 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-796985aa-7f62-4486-b113-429d9b54a2ac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:31.089413 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-796985aa-7f62-4486-b113-429d9b54a2ac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:31.097919 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-796985aa-7f62-4486-b113-429d9b54a2ac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:31.099436 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-796985aa-7f62-4486-b113-429d9b54a2ac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:31.100589 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-796985aa-7f62-4486-b113-429d9b54a2ac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.156130 Jun 24 09:44:31.101177 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 159/329] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:30 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:31.475589 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-8a8bd87c-9b03-46e9-b53b-8be085854092 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:31.476156 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-8a8bd87c-9b03-46e9-b53b-8be085854092 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:31.483633 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8a8bd87c-9b03-46e9-b53b-8be085854092 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:31.484077 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8a8bd87c-9b03-46e9-b53b-8be085854092 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:31.484844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8a8bd87c-9b03-46e9-b53b-8be085854092 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:31.485262 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8a8bd87c-9b03-46e9-b53b-8be085854092 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:31.629013 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-8a8bd87c-9b03-46e9-b53b-8be085854092 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:31.637227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-8a8bd87c-9b03-46e9-b53b-8be085854092 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1367 microversion: 2.1 time: 0.165561 Jun 24 09:44:31.637796 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 171/330] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:31 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:32.119221 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-173e0cac-0f37-45af-82e2-71aa70da21cb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:32.119855 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-173e0cac-0f37-45af-82e2-71aa70da21cb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:32.126869 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-173e0cac-0f37-45af-82e2-71aa70da21cb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:32.127472 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-173e0cac-0f37-45af-82e2-71aa70da21cb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:32.128426 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-173e0cac-0f37-45af-82e2-71aa70da21cb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:32.128884 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-173e0cac-0f37-45af-82e2-71aa70da21cb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:32.277011 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-173e0cac-0f37-45af-82e2-71aa70da21cb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:32.290646 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-173e0cac-0f37-45af-82e2-71aa70da21cb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:32.293108 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-173e0cac-0f37-45af-82e2-71aa70da21cb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:32.294935 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-173e0cac-0f37-45af-82e2-71aa70da21cb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1743 microversion: 2.20 time: 0.179955 Jun 24 09:44:32.295788 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 160/331] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:32 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1743 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:44:32.654451 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c3fa7403-efb8-4fae-841c-37a1b8cbab22 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:32.655023 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-c3fa7403-efb8-4fae-841c-37a1b8cbab22 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:32.662165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c3fa7403-efb8-4fae-841c-37a1b8cbab22 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:32.662623 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c3fa7403-efb8-4fae-841c-37a1b8cbab22 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:32.663431 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c3fa7403-efb8-4fae-841c-37a1b8cbab22 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:32.663903 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c3fa7403-efb8-4fae-841c-37a1b8cbab22 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:32.806033 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c3fa7403-efb8-4fae-841c-37a1b8cbab22 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:32.813957 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-c3fa7403-efb8-4fae-841c-37a1b8cbab22 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1367 microversion: 2.1 time: 0.163330 Jun 24 09:44:32.814563 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 172/332] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:32 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:33.321104 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-95c97977-9b7c-449a-94d9-15c701a36326 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:33.321846 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-95c97977-9b7c-449a-94d9-15c701a36326 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:33.324419 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:44:33.330701 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-95c97977-9b7c-449a-94d9-15c701a36326 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:33.331186 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-95c97977-9b7c-449a-94d9-15c701a36326 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:33.331971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-95c97977-9b7c-449a-94d9-15c701a36326 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:33.332405 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-95c97977-9b7c-449a-94d9-15c701a36326 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:33.541937 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-95c97977-9b7c-449a-94d9-15c701a36326 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:33.559462 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-95c97977-9b7c-449a-94d9-15c701a36326 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:33.566935 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-95c97977-9b7c-449a-94d9-15c701a36326 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:33.566935 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-95c97977-9b7c-449a-94d9-15c701a36326 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1743 microversion: 2.20 time: 0.249139 Jun 24 09:44:33.566935 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 161/333] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:33 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1743 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:33.831810 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1b6e2588-a4e6-495f-aedc-98089bb6b725 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:33.833070 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-1b6e2588-a4e6-495f-aedc-98089bb6b725 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:33.840362 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1b6e2588-a4e6-495f-aedc-98089bb6b725 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:33.841447 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1b6e2588-a4e6-495f-aedc-98089bb6b725 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:33.842449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1b6e2588-a4e6-495f-aedc-98089bb6b725 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:33.843761 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1b6e2588-a4e6-495f-aedc-98089bb6b725 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:34.122345 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-1b6e2588-a4e6-495f-aedc-98089bb6b725 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:34.124973 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-61663640-1512-43b4-b3c6-c645d6126ee0 req-be0cc384-5519-40ec-b86b-75db2b511f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67719189-e3da-4e2f-99cd-a136ece74789", "name": "network-vif-plugged", "status": "completed", "tag": "a8a8d8ec-532a-4f39-a19c-dd244aecac18"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:44:34.139790 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-61663640-1512-43b4-b3c6-c645d6126ee0 req-be0cc384-5519-40ec-b86b-75db2b511f2d service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:34.140496 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-61663640-1512-43b4-b3c6-c645d6126ee0 req-be0cc384-5519-40ec-b86b-75db2b511f2d service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:34.155797 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-1b6e2588-a4e6-495f-aedc-98089bb6b725 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1367 microversion: 2.1 time: 0.327974 Jun 24 09:44:34.158666 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 173/334] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:33 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:34.168739 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-61663640-1512-43b4-b3c6-c645d6126ee0 req-be0cc384-5519-40ec-b86b-75db2b511f2d service nova] Creating event network-vif-plugged:a8a8d8ec-532a-4f39-a19c-dd244aecac18 for instance 67719189-e3da-4e2f-99cd-a136ece74789 on hv-cinder-80382 Jun 24 09:44:34.176013 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-61663640-1512-43b4-b3c6-c645d6126ee0 req-be0cc384-5519-40ec-b86b-75db2b511f2d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055313 Jun 24 09:44:34.177469 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 162/335] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:44:34.595957 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-472a665c-b17e-4664-a2cf-6693d5c15e72 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:34.596662 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-472a665c-b17e-4664-a2cf-6693d5c15e72 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:34.603270 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-472a665c-b17e-4664-a2cf-6693d5c15e72 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:34.603960 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-472a665c-b17e-4664-a2cf-6693d5c15e72 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:34.604805 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-472a665c-b17e-4664-a2cf-6693d5c15e72 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:34.605384 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-472a665c-b17e-4664-a2cf-6693d5c15e72 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:34.788783 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-472a665c-b17e-4664-a2cf-6693d5c15e72 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:34.800463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-472a665c-b17e-4664-a2cf-6693d5c15e72 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:34.803372 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-472a665c-b17e-4664-a2cf-6693d5c15e72 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:34.806219 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-472a665c-b17e-4664-a2cf-6693d5c15e72 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1743 microversion: 2.20 time: 0.214295 Jun 24 09:44:34.807374 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 174/336] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:34 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1743 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:44:35.185974 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-fbba093b-6618-4954-841a-cba4732207da tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:35.187248 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-fbba093b-6618-4954-841a-cba4732207da tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:35.198143 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fbba093b-6618-4954-841a-cba4732207da tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:35.198863 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fbba093b-6618-4954-841a-cba4732207da tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:35.200259 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fbba093b-6618-4954-841a-cba4732207da tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:35.200977 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fbba093b-6618-4954-841a-cba4732207da tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:35.408945 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-fbba093b-6618-4954-841a-cba4732207da tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:35.417741 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-fbba093b-6618-4954-841a-cba4732207da tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1367 microversion: 2.1 time: 0.238717 Jun 24 09:44:35.418595 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 163/337] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:35 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:35.836498 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-483ebe46-ce0f-467e-a164-59aa6682c77d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:35.837688 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-483ebe46-ce0f-467e-a164-59aa6682c77d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:35.842428 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=54 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:44:35.854433 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-483ebe46-ce0f-467e-a164-59aa6682c77d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:35.855354 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-483ebe46-ce0f-467e-a164-59aa6682c77d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:35.857003 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-483ebe46-ce0f-467e-a164-59aa6682c77d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:35.858026 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-483ebe46-ce0f-467e-a164-59aa6682c77d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:36.077989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-483ebe46-ce0f-467e-a164-59aa6682c77d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:36.093141 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-483ebe46-ce0f-467e-a164-59aa6682c77d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:36.096905 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-483ebe46-ce0f-467e-a164-59aa6682c77d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:36.099442 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-483ebe46-ce0f-467e-a164-59aa6682c77d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1738 microversion: 2.20 time: 0.270725 Jun 24 09:44:36.108103 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 175/338] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:35 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1738 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:36.202358 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-ad042bd4-e6b7-4825-b747-7a81f271eaaa req-23391bad-77c0-4485-8d33-1beb12a888e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa551ac0-154e-4145-acc0-725155004e69", "name": "network-vif-plugged", "status": "completed", "tag": "371d87f0-d828-436b-a673-c5e34fc40e6c"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:44:36.223937 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-ad042bd4-e6b7-4825-b747-7a81f271eaaa req-23391bad-77c0-4485-8d33-1beb12a888e8 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:36.224561 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-ad042bd4-e6b7-4825-b747-7a81f271eaaa req-23391bad-77c0-4485-8d33-1beb12a888e8 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:36.257872 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-ad042bd4-e6b7-4825-b747-7a81f271eaaa req-23391bad-77c0-4485-8d33-1beb12a888e8 service nova] Creating event network-vif-plugged:371d87f0-d828-436b-a673-c5e34fc40e6c for instance aa551ac0-154e-4145-acc0-725155004e69 on hv-cinder-80382 Jun 24 09:44:36.277763 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-ad042bd4-e6b7-4825-b747-7a81f271eaaa req-23391bad-77c0-4485-8d33-1beb12a888e8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080575 Jun 24 09:44:36.284224 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 164/339] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:44:36.444579 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b2f81a0d-cf02-4f69-b787-3d7723a93eeb tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:36.445459 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-b2f81a0d-cf02-4f69-b787-3d7723a93eeb tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:36.453110 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b2f81a0d-cf02-4f69-b787-3d7723a93eeb tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:36.454419 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b2f81a0d-cf02-4f69-b787-3d7723a93eeb tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:36.456941 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b2f81a0d-cf02-4f69-b787-3d7723a93eeb tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:36.458646 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b2f81a0d-cf02-4f69-b787-3d7723a93eeb tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:36.742194 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b2f81a0d-cf02-4f69-b787-3d7723a93eeb tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:36.752444 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b2f81a0d-cf02-4f69-b787-3d7723a93eeb tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1367 microversion: 2.1 time: 0.311495 Jun 24 09:44:36.762244 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 176/340] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:36 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:37.132894 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-73f5a3fa-4f9b-4d2c-a60c-288d90da002c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:37.133815 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-73f5a3fa-4f9b-4d2c-a60c-288d90da002c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:37.168303 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-73f5a3fa-4f9b-4d2c-a60c-288d90da002c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:37.168303 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-73f5a3fa-4f9b-4d2c-a60c-288d90da002c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:37.175107 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-73f5a3fa-4f9b-4d2c-a60c-288d90da002c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:37.181175 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-73f5a3fa-4f9b-4d2c-a60c-288d90da002c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:37.216421 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=100 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:44:37.429900 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-73f5a3fa-4f9b-4d2c-a60c-288d90da002c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:37.440503 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-73f5a3fa-4f9b-4d2c-a60c-288d90da002c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:37.442328 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-73f5a3fa-4f9b-4d2c-a60c-288d90da002c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:37.443791 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-73f5a3fa-4f9b-4d2c-a60c-288d90da002c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1738 microversion: 2.20 time: 0.315909 Jun 24 09:44:37.444870 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 165/341] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:37 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1738 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:37.770367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f8a897e2-8cd4-446d-b125-90f950d92703 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:37.771100 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-f8a897e2-8cd4-446d-b125-90f950d92703 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:37.792547 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f8a897e2-8cd4-446d-b125-90f950d92703 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:37.793784 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f8a897e2-8cd4-446d-b125-90f950d92703 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:37.795248 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f8a897e2-8cd4-446d-b125-90f950d92703 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:37.796239 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f8a897e2-8cd4-446d-b125-90f950d92703 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:38.082528 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-f8a897e2-8cd4-446d-b125-90f950d92703 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:38.095210 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f8a897e2-8cd4-446d-b125-90f950d92703 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1367 microversion: 2.1 time: 0.329722 Jun 24 09:44:38.097673 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 177/342] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:37 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:38.466654 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-f061e89a-8ec8-4838-90b3-2f73fe806581 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:38.466654 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-f061e89a-8ec8-4838-90b3-2f73fe806581 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:38.477083 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f061e89a-8ec8-4838-90b3-2f73fe806581 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:38.478297 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f061e89a-8ec8-4838-90b3-2f73fe806581 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:38.479121 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f061e89a-8ec8-4838-90b3-2f73fe806581 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:38.479565 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f061e89a-8ec8-4838-90b3-2f73fe806581 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:38.719640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f061e89a-8ec8-4838-90b3-2f73fe806581 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:38.732466 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f061e89a-8ec8-4838-90b3-2f73fe806581 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:38.734644 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f061e89a-8ec8-4838-90b3-2f73fe806581 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:38.736960 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-f061e89a-8ec8-4838-90b3-2f73fe806581 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1738 microversion: 2.20 time: 0.275160 Jun 24 09:44:38.738035 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 166/343] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:38 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1738 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:39.115623 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-017de4df-a043-47f7-b128-4f83976566e0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:39.116973 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-017de4df-a043-47f7-b128-4f83976566e0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:39.126253 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-017de4df-a043-47f7-b128-4f83976566e0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:39.142981 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-017de4df-a043-47f7-b128-4f83976566e0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:39.144342 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-017de4df-a043-47f7-b128-4f83976566e0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:39.144819 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-017de4df-a043-47f7-b128-4f83976566e0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:39.358718 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-017de4df-a043-47f7-b128-4f83976566e0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:39.371343 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-017de4df-a043-47f7-b128-4f83976566e0 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1367 microversion: 2.1 time: 0.260867 Jun 24 09:44:39.372157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 178/344] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:39 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:39.763508 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-12210166-0f9f-45ef-a8d8-570be5fd0bad tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:39.763508 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-12210166-0f9f-45ef-a8d8-570be5fd0bad tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:39.771823 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-12210166-0f9f-45ef-a8d8-570be5fd0bad tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:39.772273 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-12210166-0f9f-45ef-a8d8-570be5fd0bad tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:39.778427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-12210166-0f9f-45ef-a8d8-570be5fd0bad tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:39.778894 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-12210166-0f9f-45ef-a8d8-570be5fd0bad tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:40.062151 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-12210166-0f9f-45ef-a8d8-570be5fd0bad tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:40.071364 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-12210166-0f9f-45ef-a8d8-570be5fd0bad tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:40.075314 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-12210166-0f9f-45ef-a8d8-570be5fd0bad tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:40.077955 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-12210166-0f9f-45ef-a8d8-570be5fd0bad tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1738 microversion: 2.20 time: 0.323473 Jun 24 09:44:40.079566 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 167/345] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:39 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1738 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:44:40.389108 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e5858110-8f49-4eb0-88cc-ef0d1d0951fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:40.390407 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e5858110-8f49-4eb0-88cc-ef0d1d0951fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:40.401817 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e5858110-8f49-4eb0-88cc-ef0d1d0951fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:40.408365 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e5858110-8f49-4eb0-88cc-ef0d1d0951fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:40.409359 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e5858110-8f49-4eb0-88cc-ef0d1d0951fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:40.409808 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e5858110-8f49-4eb0-88cc-ef0d1d0951fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:40.706644 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e5858110-8f49-4eb0-88cc-ef0d1d0951fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:40.718803 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e5858110-8f49-4eb0-88cc-ef0d1d0951fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1556 microversion: 2.1 time: 0.333344 Jun 24 09:44:40.720491 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 179/346] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:40 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1556 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:40.736157 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-be1ebfd9-338e-4f34-a0b0-338d8d8fabaf tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:40.736659 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-be1ebfd9-338e-4f34-a0b0-338d8d8fabaf tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:40.750577 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-be1ebfd9-338e-4f34-a0b0-338d8d8fabaf tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:40.751484 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-be1ebfd9-338e-4f34-a0b0-338d8d8fabaf tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:40.752451 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-be1ebfd9-338e-4f34-a0b0-338d8d8fabaf tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:40.753158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-be1ebfd9-338e-4f34-a0b0-338d8d8fabaf tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:40.906984 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-be1ebfd9-338e-4f34-a0b0-338d8d8fabaf tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.174817 Jun 24 09:44:40.909598 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 168/347] 10.222.0.65 () {58 vars in 1274 bytes} [Fri Jun 24 09:44:40 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:44:41.101192 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-678c3404-a041-4b73-a563-da8eb98f8f9a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:41.101831 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-678c3404-a041-4b73-a563-da8eb98f8f9a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:41.129945 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-678c3404-a041-4b73-a563-da8eb98f8f9a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:41.129945 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-678c3404-a041-4b73-a563-da8eb98f8f9a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:41.130436 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-678c3404-a041-4b73-a563-da8eb98f8f9a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:41.132746 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-678c3404-a041-4b73-a563-da8eb98f8f9a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:41.730199 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-678c3404-a041-4b73-a563-da8eb98f8f9a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:41.774608 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-678c3404-a041-4b73-a563-da8eb98f8f9a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:41.777818 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-678c3404-a041-4b73-a563-da8eb98f8f9a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:41.785946 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-678c3404-a041-4b73-a563-da8eb98f8f9a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1738 microversion: 2.20 time: 0.690779 Jun 24 09:44:41.786901 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 180/348] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:41 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1738 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:42.759877 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-83b79c52-a5d9-4af0-9ad7-8b012221003e req-435a5f24-ffa2-4827-84f9-57eca098c1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67719189-e3da-4e2f-99cd-a136ece74789", "tag": "a8a8d8ec-532a-4f39-a19c-dd244aecac18"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:44:42.774174 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-83b79c52-a5d9-4af0-9ad7-8b012221003e req-435a5f24-ffa2-4827-84f9-57eca098c1b2 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:42.774627 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-83b79c52-a5d9-4af0-9ad7-8b012221003e req-435a5f24-ffa2-4827-84f9-57eca098c1b2 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:42.793257 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-83b79c52-a5d9-4af0-9ad7-8b012221003e req-435a5f24-ffa2-4827-84f9-57eca098c1b2 service nova] Creating event network-changed:a8a8d8ec-532a-4f39-a19c-dd244aecac18 for instance 67719189-e3da-4e2f-99cd-a136ece74789 on hv-cinder-80382 Jun 24 09:44:42.800660 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-83b79c52-a5d9-4af0-9ad7-8b012221003e req-435a5f24-ffa2-4827-84f9-57eca098c1b2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045932 Jun 24 09:44:42.801638 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 169/349] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:44:42.804564 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-118d8c06-f594-42b4-8249-058b75a9dac3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:42.805212 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-118d8c06-f594-42b4-8249-058b75a9dac3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:42.816213 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-118d8c06-f594-42b4-8249-058b75a9dac3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:42.816213 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-118d8c06-f594-42b4-8249-058b75a9dac3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:42.817557 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-118d8c06-f594-42b4-8249-058b75a9dac3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:42.817988 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-118d8c06-f594-42b4-8249-058b75a9dac3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:43.105433 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-118d8c06-f594-42b4-8249-058b75a9dac3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:43.117725 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-118d8c06-f594-42b4-8249-058b75a9dac3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:43.125108 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-118d8c06-f594-42b4-8249-058b75a9dac3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:43.126851 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-118d8c06-f594-42b4-8249-058b75a9dac3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1738 microversion: 2.20 time: 0.326145 Jun 24 09:44:43.130494 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 181/350] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:42 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1738 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:44:44.147989 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-169f9de8-f59e-46e1-9f37-e4cd06a18b3f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:44.149371 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-169f9de8-f59e-46e1-9f37-e4cd06a18b3f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:44.161534 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-169f9de8-f59e-46e1-9f37-e4cd06a18b3f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:44.161993 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-169f9de8-f59e-46e1-9f37-e4cd06a18b3f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:44.162774 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-169f9de8-f59e-46e1-9f37-e4cd06a18b3f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:44.166235 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-169f9de8-f59e-46e1-9f37-e4cd06a18b3f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:44.444294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-169f9de8-f59e-46e1-9f37-e4cd06a18b3f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:44.461658 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-169f9de8-f59e-46e1-9f37-e4cd06a18b3f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:44.463470 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-169f9de8-f59e-46e1-9f37-e4cd06a18b3f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:44.478431 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-169f9de8-f59e-46e1-9f37-e4cd06a18b3f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1738 microversion: 2.20 time: 0.335220 Jun 24 09:44:44.481913 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 170/351] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:44 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1738 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:45.503831 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-6c460f7c-3b1b-4500-8029-f8a69b9c87c5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:45.504443 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-6c460f7c-3b1b-4500-8029-f8a69b9c87c5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:45.512566 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6c460f7c-3b1b-4500-8029-f8a69b9c87c5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:45.513024 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6c460f7c-3b1b-4500-8029-f8a69b9c87c5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:45.513812 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6c460f7c-3b1b-4500-8029-f8a69b9c87c5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:45.514248 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6c460f7c-3b1b-4500-8029-f8a69b9c87c5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:45.822153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6c460f7c-3b1b-4500-8029-f8a69b9c87c5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:45.833262 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6c460f7c-3b1b-4500-8029-f8a69b9c87c5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:45.835342 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6c460f7c-3b1b-4500-8029-f8a69b9c87c5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:45.839199 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-6c460f7c-3b1b-4500-8029-f8a69b9c87c5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1738 microversion: 2.20 time: 0.338287 Jun 24 09:44:45.841456 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 182/352] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:45 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1738 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:46.865562 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-e3baebf7-7a7a-4748-8485-31434a942cd1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:46.868643 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-e3baebf7-7a7a-4748-8485-31434a942cd1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:46.895776 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e3baebf7-7a7a-4748-8485-31434a942cd1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:46.896232 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e3baebf7-7a7a-4748-8485-31434a942cd1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:46.897038 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e3baebf7-7a7a-4748-8485-31434a942cd1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:46.897475 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e3baebf7-7a7a-4748-8485-31434a942cd1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:47.130265 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-e3baebf7-7a7a-4748-8485-31434a942cd1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:47.140007 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-e3baebf7-7a7a-4748-8485-31434a942cd1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:47.141627 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-e3baebf7-7a7a-4748-8485-31434a942cd1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:47.146182 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-e3baebf7-7a7a-4748-8485-31434a942cd1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1738 microversion: 2.20 time: 0.288206 Jun 24 09:44:47.159970 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 171/353] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:46 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1738 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:48.165074 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-10ddd57e-1594-4b05-939d-8cb30b424f51 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:48.166293 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-10ddd57e-1594-4b05-939d-8cb30b424f51 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:48.183230 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-10ddd57e-1594-4b05-939d-8cb30b424f51 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:48.184086 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-10ddd57e-1594-4b05-939d-8cb30b424f51 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:48.188091 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-10ddd57e-1594-4b05-939d-8cb30b424f51 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:48.191161 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-10ddd57e-1594-4b05-939d-8cb30b424f51 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:48.571401 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-10ddd57e-1594-4b05-939d-8cb30b424f51 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:48.585678 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-10ddd57e-1594-4b05-939d-8cb30b424f51 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:48.589838 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-10ddd57e-1594-4b05-939d-8cb30b424f51 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:48.597008 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-10ddd57e-1594-4b05-939d-8cb30b424f51 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1738 microversion: 2.20 time: 0.436172 Jun 24 09:44:48.599828 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 183/354] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:48 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1738 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:49.617861 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-412ca223-9867-471c-9596-b55b373fe9cc tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:49.618552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-412ca223-9867-471c-9596-b55b373fe9cc tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:49.629969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-412ca223-9867-471c-9596-b55b373fe9cc tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:49.630422 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-412ca223-9867-471c-9596-b55b373fe9cc tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:49.631242 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-412ca223-9867-471c-9596-b55b373fe9cc tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:49.631680 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-412ca223-9867-471c-9596-b55b373fe9cc tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:50.017596 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-412ca223-9867-471c-9596-b55b373fe9cc tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:50.030922 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-412ca223-9867-471c-9596-b55b373fe9cc tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:50.033847 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-412ca223-9867-471c-9596-b55b373fe9cc tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:50.035656 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-412ca223-9867-471c-9596-b55b373fe9cc tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1738 microversion: 2.20 time: 0.422243 Jun 24 09:44:50.048954 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 172/355] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:49 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1738 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:51.056519 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-844d9904-a6a8-4aec-8965-2bf3cad1c2e3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:51.058127 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-844d9904-a6a8-4aec-8965-2bf3cad1c2e3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:51.075120 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-844d9904-a6a8-4aec-8965-2bf3cad1c2e3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:51.075937 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-844d9904-a6a8-4aec-8965-2bf3cad1c2e3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:51.076907 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-844d9904-a6a8-4aec-8965-2bf3cad1c2e3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:51.077511 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-844d9904-a6a8-4aec-8965-2bf3cad1c2e3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:51.351220 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-844d9904-a6a8-4aec-8965-2bf3cad1c2e3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:51.373233 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-844d9904-a6a8-4aec-8965-2bf3cad1c2e3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:51.374822 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-844d9904-a6a8-4aec-8965-2bf3cad1c2e3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:51.376351 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-844d9904-a6a8-4aec-8965-2bf3cad1c2e3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1738 microversion: 2.20 time: 0.325350 Jun 24 09:44:51.377625 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 184/356] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:51 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1738 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:52.399343 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-1799c2a7-7d32-426c-ac45-f5e844b49314 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:52.406472 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-1799c2a7-7d32-426c-ac45-f5e844b49314 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:52.426798 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1799c2a7-7d32-426c-ac45-f5e844b49314 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:52.430659 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1799c2a7-7d32-426c-ac45-f5e844b49314 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:52.432285 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1799c2a7-7d32-426c-ac45-f5e844b49314 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:52.432888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1799c2a7-7d32-426c-ac45-f5e844b49314 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:52.661291 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-1799c2a7-7d32-426c-ac45-f5e844b49314 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:52.671347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-1799c2a7-7d32-426c-ac45-f5e844b49314 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:52.674262 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-1799c2a7-7d32-426c-ac45-f5e844b49314 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:52.675874 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-1799c2a7-7d32-426c-ac45-f5e844b49314 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1738 microversion: 2.20 time: 0.284601 Jun 24 09:44:52.687903 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 173/357] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:52 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1738 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:53.695796 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3efba10a-bf2b-4ee5-b240-d7e4ecead80b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:53.697642 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3efba10a-bf2b-4ee5-b240-d7e4ecead80b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:53.708733 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3efba10a-bf2b-4ee5-b240-d7e4ecead80b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:53.716950 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3efba10a-bf2b-4ee5-b240-d7e4ecead80b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:53.722074 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3efba10a-bf2b-4ee5-b240-d7e4ecead80b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:53.729012 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3efba10a-bf2b-4ee5-b240-d7e4ecead80b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:54.055760 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-038d78e4-1217-4569-817f-fd9a6e9ae94e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:54.056394 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-038d78e4-1217-4569-817f-fd9a6e9ae94e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:54.067399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-038d78e4-1217-4569-817f-fd9a6e9ae94e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:54.067852 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-038d78e4-1217-4569-817f-fd9a6e9ae94e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:54.070138 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-038d78e4-1217-4569-817f-fd9a6e9ae94e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:54.070761 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-038d78e4-1217-4569-817f-fd9a6e9ae94e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:54.093945 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3efba10a-bf2b-4ee5-b240-d7e4ecead80b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:54.104991 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3efba10a-bf2b-4ee5-b240-d7e4ecead80b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:54.108492 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3efba10a-bf2b-4ee5-b240-d7e4ecead80b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:54.111579 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3efba10a-bf2b-4ee5-b240-d7e4ecead80b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1738 microversion: 2.20 time: 0.420164 Jun 24 09:44:54.113774 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 185/358] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:53 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1738 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:54.375065 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.objects.instance [None req-038d78e4-1217-4569-817f-fd9a6e9ae94e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lazy-loading 'services' on Instance uuid ce0dadb5-652d-42b9-90aa-461f74d68dca {{(pid=124338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:44:54.603344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-038d78e4-1217-4569-817f-fd9a6e9ae94e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca/os-volume_attachments/4cc44ed1-3c40-40b9-a209-5d55b8c60d8f" status: 202 len: 0 microversion: 2.1 time: 0.551590 Jun 24 09:44:54.607726 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 174/359] 10.222.0.65 () {58 vars in 1415 bytes} [Fri Jun 24 09:44:54 2022] DELETE /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca/os-volume_attachments/4cc44ed1-3c40-40b9-a209-5d55b8c60d8f => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 09:44:55.135372 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3d9c7471-ccdf-4ebf-bf2b-112f7bdbec91 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:55.136703 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3d9c7471-ccdf-4ebf-bf2b-112f7bdbec91 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:55.146486 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3d9c7471-ccdf-4ebf-bf2b-112f7bdbec91 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:55.147154 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3d9c7471-ccdf-4ebf-bf2b-112f7bdbec91 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:55.148260 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3d9c7471-ccdf-4ebf-bf2b-112f7bdbec91 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:55.148893 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3d9c7471-ccdf-4ebf-bf2b-112f7bdbec91 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:55.420508 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3d9c7471-ccdf-4ebf-bf2b-112f7bdbec91 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:55.430155 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3d9c7471-ccdf-4ebf-bf2b-112f7bdbec91 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:55.432305 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3d9c7471-ccdf-4ebf-bf2b-112f7bdbec91 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:55.433921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3d9c7471-ccdf-4ebf-bf2b-112f7bdbec91 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1738 microversion: 2.20 time: 0.304775 Jun 24 09:44:55.446213 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 186/360] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:55 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1738 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:56.456226 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-e4f84a94-24d3-42e6-8c1d-0a75cb736be1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:56.456927 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-e4f84a94-24d3-42e6-8c1d-0a75cb736be1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:56.468285 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e4f84a94-24d3-42e6-8c1d-0a75cb736be1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:56.469104 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e4f84a94-24d3-42e6-8c1d-0a75cb736be1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:56.470336 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e4f84a94-24d3-42e6-8c1d-0a75cb736be1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:56.471224 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e4f84a94-24d3-42e6-8c1d-0a75cb736be1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:56.714207 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-e4f84a94-24d3-42e6-8c1d-0a75cb736be1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:56.724210 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-e4f84a94-24d3-42e6-8c1d-0a75cb736be1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:56.726175 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-e4f84a94-24d3-42e6-8c1d-0a75cb736be1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:56.728018 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-e4f84a94-24d3-42e6-8c1d-0a75cb736be1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1720 microversion: 2.20 time: 0.278461 Jun 24 09:44:56.740292 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 175/361] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:56 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1720 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:56.936159 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-57805ab7-df9c-4293-8222-53be99bf1663 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:56.936743 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-57805ab7-df9c-4293-8222-53be99bf1663 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:56.944266 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-57805ab7-df9c-4293-8222-53be99bf1663 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:56.944714 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-57805ab7-df9c-4293-8222-53be99bf1663 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:56.945485 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-57805ab7-df9c-4293-8222-53be99bf1663 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:56.945912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-57805ab7-df9c-4293-8222-53be99bf1663 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:56.972241 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=100 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:44:56.978191 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-57805ab7-df9c-4293-8222-53be99bf1663 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Going to try to terminate instance {{(pid=124339) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:44:57.089904 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-57805ab7-df9c-4293-8222-53be99bf1663 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 204 len: 0 microversion: 2.1 time: 0.170344 Jun 24 09:44:57.091366 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 187/362] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:44:56 2022] DELETE /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:44:57.099974 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-62183c76-1b25-4c0b-a25f-456b7d1e7e6e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:57.101169 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-62183c76-1b25-4c0b-a25f-456b7d1e7e6e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:57.110208 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-62183c76-1b25-4c0b-a25f-456b7d1e7e6e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:57.111180 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-62183c76-1b25-4c0b-a25f-456b7d1e7e6e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:57.112123 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-62183c76-1b25-4c0b-a25f-456b7d1e7e6e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:57.112704 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-62183c76-1b25-4c0b-a25f-456b7d1e7e6e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:57.369446 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-62183c76-1b25-4c0b-a25f-456b7d1e7e6e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:57.378763 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-62183c76-1b25-4c0b-a25f-456b7d1e7e6e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1514 microversion: 2.1 time: 0.282652 Jun 24 09:44:57.380199 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 176/363] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:57 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1514 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:57.758925 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-fa1a27a6-e57c-4c90-873b-bfef6dc7534d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:57.761908 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-fa1a27a6-e57c-4c90-873b-bfef6dc7534d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:57.777557 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fa1a27a6-e57c-4c90-873b-bfef6dc7534d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:57.778337 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fa1a27a6-e57c-4c90-873b-bfef6dc7534d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:57.780862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fa1a27a6-e57c-4c90-873b-bfef6dc7534d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:57.781818 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fa1a27a6-e57c-4c90-873b-bfef6dc7534d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:57.975142 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-fa1a27a6-e57c-4c90-873b-bfef6dc7534d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:57.991840 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-fa1a27a6-e57c-4c90-873b-bfef6dc7534d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:57.994286 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-fa1a27a6-e57c-4c90-873b-bfef6dc7534d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:57.995566 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-fa1a27a6-e57c-4c90-873b-bfef6dc7534d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1720 microversion: 2.20 time: 0.250692 Jun 24 09:44:57.999292 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 188/364] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:57 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1720 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:58.396572 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-3eec1e2c-9436-44a1-a830-5d5cf4564951 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:58.397445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-3eec1e2c-9436-44a1-a830-5d5cf4564951 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:58.404483 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3eec1e2c-9436-44a1-a830-5d5cf4564951 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:58.405204 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3eec1e2c-9436-44a1-a830-5d5cf4564951 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:58.406125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3eec1e2c-9436-44a1-a830-5d5cf4564951 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:58.406789 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3eec1e2c-9436-44a1-a830-5d5cf4564951 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:58.565965 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-3eec1e2c-9436-44a1-a830-5d5cf4564951 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:58.574338 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-3eec1e2c-9436-44a1-a830-5d5cf4564951 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1514 microversion: 2.1 time: 0.181649 Jun 24 09:44:58.574920 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 177/365] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:58 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:44:59.015672 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-5966f4de-17fd-42c7-a5dd-eae29fb0fd95 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:59.017052 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-5966f4de-17fd-42c7-a5dd-eae29fb0fd95 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:59.027153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5966f4de-17fd-42c7-a5dd-eae29fb0fd95 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:59.028900 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5966f4de-17fd-42c7-a5dd-eae29fb0fd95 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:59.030197 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5966f4de-17fd-42c7-a5dd-eae29fb0fd95 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:59.030831 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5966f4de-17fd-42c7-a5dd-eae29fb0fd95 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:59.235454 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-5966f4de-17fd-42c7-a5dd-eae29fb0fd95 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:59.245504 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-5966f4de-17fd-42c7-a5dd-eae29fb0fd95 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:59.249354 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-5966f4de-17fd-42c7-a5dd-eae29fb0fd95 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:59.250843 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-5966f4de-17fd-42c7-a5dd-eae29fb0fd95 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1720 microversion: 2.20 time: 0.239140 Jun 24 09:44:59.252113 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 189/366] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:44:59 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1720 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:44:59.591495 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-6d7d40ae-1776-4120-b6ee-064f35a47371 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:44:59.592308 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-6d7d40ae-1776-4120-b6ee-064f35a47371 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:44:59.600345 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6d7d40ae-1776-4120-b6ee-064f35a47371 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:59.601125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6d7d40ae-1776-4120-b6ee-064f35a47371 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:59.602526 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6d7d40ae-1776-4120-b6ee-064f35a47371 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:44:59.603188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6d7d40ae-1776-4120-b6ee-064f35a47371 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:44:59.825063 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-6d7d40ae-1776-4120-b6ee-064f35a47371 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:44:59.842502 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-6d7d40ae-1776-4120-b6ee-064f35a47371 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1514 microversion: 2.1 time: 0.254844 Jun 24 09:44:59.843511 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 178/367] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:44:59 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1514 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:00.270842 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-012c0368-0369-4f4b-8b2b-097bd1fc4aed tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:00.271507 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-012c0368-0369-4f4b-8b2b-097bd1fc4aed tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:00.278489 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-012c0368-0369-4f4b-8b2b-097bd1fc4aed tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:00.285318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-012c0368-0369-4f4b-8b2b-097bd1fc4aed tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:00.286287 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-012c0368-0369-4f4b-8b2b-097bd1fc4aed tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:00.288307 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-012c0368-0369-4f4b-8b2b-097bd1fc4aed tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:00.471645 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-012c0368-0369-4f4b-8b2b-097bd1fc4aed tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:00.481332 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-012c0368-0369-4f4b-8b2b-097bd1fc4aed tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:00.482858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-012c0368-0369-4f4b-8b2b-097bd1fc4aed tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:00.484096 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-012c0368-0369-4f4b-8b2b-097bd1fc4aed tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1720 microversion: 2.20 time: 0.218325 Jun 24 09:45:00.494806 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 190/368] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:00 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1720 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:00.861495 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7cfe8968-a469-4e4a-8886-77dc6a22f30f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:00.862983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-7cfe8968-a469-4e4a-8886-77dc6a22f30f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:00.874220 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7cfe8968-a469-4e4a-8886-77dc6a22f30f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:00.875605 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7cfe8968-a469-4e4a-8886-77dc6a22f30f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:00.876749 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7cfe8968-a469-4e4a-8886-77dc6a22f30f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:00.877493 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7cfe8968-a469-4e4a-8886-77dc6a22f30f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:01.052961 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-7cfe8968-a469-4e4a-8886-77dc6a22f30f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:01.061887 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-7cfe8968-a469-4e4a-8886-77dc6a22f30f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1514 microversion: 2.1 time: 0.204987 Jun 24 09:45:01.074440 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 179/369] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:00 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1514 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:45:01.505642 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-8c1d956e-5a24-4113-9b4d-e1c64930d642 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:01.506881 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-8c1d956e-5a24-4113-9b4d-e1c64930d642 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:01.514468 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8c1d956e-5a24-4113-9b4d-e1c64930d642 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:01.515065 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8c1d956e-5a24-4113-9b4d-e1c64930d642 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:01.517168 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8c1d956e-5a24-4113-9b4d-e1c64930d642 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:01.517835 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8c1d956e-5a24-4113-9b4d-e1c64930d642 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:01.526774 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-8948c55f-c041-4f4b-bf93-cc42d6484e52 req-431ccb35-60ac-4520-8c16-a93c6ca58ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa551ac0-154e-4145-acc0-725155004e69", "name": "network-vif-unplugged", "status": "completed", "tag": "371d87f0-d828-436b-a673-c5e34fc40e6c"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:01.539934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-8948c55f-c041-4f4b-bf93-cc42d6484e52 req-431ccb35-60ac-4520-8c16-a93c6ca58ee5 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:01.541685 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-8948c55f-c041-4f4b-bf93-cc42d6484e52 req-431ccb35-60ac-4520-8c16-a93c6ca58ee5 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:01.579913 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-8948c55f-c041-4f4b-bf93-cc42d6484e52 req-431ccb35-60ac-4520-8c16-a93c6ca58ee5 service nova] Creating event network-vif-unplugged:371d87f0-d828-436b-a673-c5e34fc40e6c for instance aa551ac0-154e-4145-acc0-725155004e69 on hv-cinder-80382 Jun 24 09:45:01.589357 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-8948c55f-c041-4f4b-bf93-cc42d6484e52 req-431ccb35-60ac-4520-8c16-a93c6ca58ee5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069946 Jun 24 09:45:01.592414 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 180/370] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:45:01.736387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-8c1d956e-5a24-4113-9b4d-e1c64930d642 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:01.745616 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-8c1d956e-5a24-4113-9b4d-e1c64930d642 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:01.747486 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-8c1d956e-5a24-4113-9b4d-e1c64930d642 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:01.751818 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-8c1d956e-5a24-4113-9b4d-e1c64930d642 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1720 microversion: 2.20 time: 0.248406 Jun 24 09:45:01.752417 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 191/371] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:01 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1720 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:02.081176 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-a7ae17c1-953c-4e4f-a05d-b4d4b54b7ff9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:02.081797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-a7ae17c1-953c-4e4f-a05d-b4d4b54b7ff9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:02.088639 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a7ae17c1-953c-4e4f-a05d-b4d4b54b7ff9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:02.089387 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a7ae17c1-953c-4e4f-a05d-b4d4b54b7ff9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:02.090306 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a7ae17c1-953c-4e4f-a05d-b4d4b54b7ff9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:02.091039 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a7ae17c1-953c-4e4f-a05d-b4d4b54b7ff9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:02.251245 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-a7ae17c1-953c-4e4f-a05d-b4d4b54b7ff9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:02.259472 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-a7ae17c1-953c-4e4f-a05d-b4d4b54b7ff9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1514 microversion: 2.1 time: 0.183287 Jun 24 09:45:02.260061 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 181/372] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:02 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:02.770709 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-94a33499-eec2-4a79-a3c9-dbcbcd079e96 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:02.771346 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-94a33499-eec2-4a79-a3c9-dbcbcd079e96 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:02.778422 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-94a33499-eec2-4a79-a3c9-dbcbcd079e96 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:02.778859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-94a33499-eec2-4a79-a3c9-dbcbcd079e96 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:02.779670 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-94a33499-eec2-4a79-a3c9-dbcbcd079e96 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:02.780098 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-94a33499-eec2-4a79-a3c9-dbcbcd079e96 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:02.928061 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-94a33499-eec2-4a79-a3c9-dbcbcd079e96 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:02.936669 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-94a33499-eec2-4a79-a3c9-dbcbcd079e96 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:02.939027 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-94a33499-eec2-4a79-a3c9-dbcbcd079e96 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:02.941312 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-94a33499-eec2-4a79-a3c9-dbcbcd079e96 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1723 microversion: 2.20 time: 0.174666 Jun 24 09:45:02.942088 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 192/373] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:02 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:02.960383 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-b553930d-2a59-441f-aaba-6f441d37e61c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b49c294a-a77e-4c82-af10-41db5005addc"}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:02.962847 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-b553930d-2a59-441f-aaba-6f441d37e61c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:02.972723 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b553930d-2a59-441f-aaba-6f441d37e61c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:02.973285 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b553930d-2a59-441f-aaba-6f441d37e61c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:02.974139 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b553930d-2a59-441f-aaba-6f441d37e61c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:02.974567 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b553930d-2a59-441f-aaba-6f441d37e61c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:03.075583 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:03.280884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-48a784c9-6512-4aea-af36-de4691d5457f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:03.285413 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-48a784c9-6512-4aea-af36-de4691d5457f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:03.301536 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-48a784c9-6512-4aea-af36-de4691d5457f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:03.308007 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-48a784c9-6512-4aea-af36-de4691d5457f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:03.311394 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-48a784c9-6512-4aea-af36-de4691d5457f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:03.311860 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-48a784c9-6512-4aea-af36-de4691d5457f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:03.446151 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-b553930d-2a59-441f-aaba-6f441d37e61c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "POST /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.490790 Jun 24 09:45:03.447300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 182/374] 10.222.0.65 () {62 vars in 1363 bytes} [Fri Jun 24 09:45:02 2022] POST /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69/os-volume_attachments => generated 188 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 09:45:03.576445 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-48a784c9-6512-4aea-af36-de4691d5457f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:03.585838 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-48a784c9-6512-4aea-af36-de4691d5457f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1514 microversion: 2.1 time: 0.311833 Jun 24 09:45:03.596206 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 193/375] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:03 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1514 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:03.667982 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-3c4c6099-3974-4f84-af36-5e5c4f8d24e7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:03.669138 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-3c4c6099-3974-4f84-af36-5e5c4f8d24e7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:03.675794 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=44 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:03.678418 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3c4c6099-3974-4f84-af36-5e5c4f8d24e7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:03.679055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3c4c6099-3974-4f84-af36-5e5c4f8d24e7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:03.680475 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3c4c6099-3974-4f84-af36-5e5c4f8d24e7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:03.682054 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3c4c6099-3974-4f84-af36-5e5c4f8d24e7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:03.877361 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-3c4c6099-3974-4f84-af36-5e5c4f8d24e7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "POST /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69/action" status: 202 len: 0 microversion: 2.20 time: 0.213804 Jun 24 09:45:03.886572 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3a23838d-5157-49de-b12b-8aa15dc632eb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:03.888714 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3a23838d-5157-49de-b12b-8aa15dc632eb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:03.895630 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 183/376] 10.222.0.65 () {62 vars in 1318 bytes} [Fri Jun 24 09:45:03 2022] POST /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:45:03.896708 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3a23838d-5157-49de-b12b-8aa15dc632eb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:03.897378 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3a23838d-5157-49de-b12b-8aa15dc632eb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:03.898374 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3a23838d-5157-49de-b12b-8aa15dc632eb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:03.899020 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3a23838d-5157-49de-b12b-8aa15dc632eb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:04.076584 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3a23838d-5157-49de-b12b-8aa15dc632eb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:04.087906 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3a23838d-5157-49de-b12b-8aa15dc632eb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:04.090316 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3a23838d-5157-49de-b12b-8aa15dc632eb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:04.092113 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3a23838d-5157-49de-b12b-8aa15dc632eb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1749 microversion: 2.20 time: 0.209486 Jun 24 09:45:04.093227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 194/377] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:03 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1749 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:04.228554 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-47f02414-31ab-453b-89d8-8cd7ea3fc21e req-b04208bb-291d-4649-8676-bdbdbbee8c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0dadb5-652d-42b9-90aa-461f74d68dca", "name": "network-vif-deleted", "tag": "572f669e-9d6a-459f-b60d-673ffe96ade9"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:04.239520 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-47f02414-31ab-453b-89d8-8cd7ea3fc21e req-b04208bb-291d-4649-8676-bdbdbbee8c92 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:04.239971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-47f02414-31ab-453b-89d8-8cd7ea3fc21e req-b04208bb-291d-4649-8676-bdbdbbee8c92 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:04.258698 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-47f02414-31ab-453b-89d8-8cd7ea3fc21e req-b04208bb-291d-4649-8676-bdbdbbee8c92 service nova] Creating event network-vif-deleted:572f669e-9d6a-459f-b60d-673ffe96ade9 for instance ce0dadb5-652d-42b9-90aa-461f74d68dca on hv-cinder-80382 Jun 24 09:45:04.264635 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-47f02414-31ab-453b-89d8-8cd7ea3fc21e req-b04208bb-291d-4649-8676-bdbdbbee8c92 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040598 Jun 24 09:45:04.265241 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 184/378] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:45:04.603876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-af22bc03-488a-4b4a-a268-886ac6de5689 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:04.613349 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-af22bc03-488a-4b4a-a268-886ac6de5689 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:04.628005 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-af22bc03-488a-4b4a-a268-886ac6de5689 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:04.628952 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-af22bc03-488a-4b4a-a268-886ac6de5689 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:04.633613 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-af22bc03-488a-4b4a-a268-886ac6de5689 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:04.634309 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-af22bc03-488a-4b4a-a268-886ac6de5689 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:04.674876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-af22bc03-488a-4b4a-a268-886ac6de5689 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:04.675662 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-af22bc03-488a-4b4a-a268-886ac6de5689 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:04.676357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.objects.instance [None req-af22bc03-488a-4b4a-a268-886ac6de5689 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lazy-loading 'fault' on Instance uuid ce0dadb5-652d-42b9-90aa-461f74d68dca {{(pid=124339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:45:04.727321 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-af22bc03-488a-4b4a-a268-886ac6de5689 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:04.739283 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-af22bc03-488a-4b4a-a268-886ac6de5689 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 200 len: 1309 microversion: 2.1 time: 0.139775 Jun 24 09:45:04.740797 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 195/379] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:04 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 1309 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:05.117243 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-e6d10962-7944-4f37-b976-4d32c579f6e8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:05.117929 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-e6d10962-7944-4f37-b976-4d32c579f6e8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:05.124540 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e6d10962-7944-4f37-b976-4d32c579f6e8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:05.125325 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e6d10962-7944-4f37-b976-4d32c579f6e8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:05.126380 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e6d10962-7944-4f37-b976-4d32c579f6e8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:05.127005 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e6d10962-7944-4f37-b976-4d32c579f6e8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:05.277152 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-e6d10962-7944-4f37-b976-4d32c579f6e8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:05.286316 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-e6d10962-7944-4f37-b976-4d32c579f6e8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:05.287887 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-e6d10962-7944-4f37-b976-4d32c579f6e8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:05.289181 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-e6d10962-7944-4f37-b976-4d32c579f6e8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1749 microversion: 2.20 time: 0.178865 Jun 24 09:45:05.300277 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 185/380] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:05 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1749 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:05.769655 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-184f0633-e7d8-4f7d-92f7-aab9202f16b6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:05.770265 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-184f0633-e7d8-4f7d-92f7-aab9202f16b6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: ce0dadb5-652d-42b9-90aa-461f74d68dca] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:05.777721 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-184f0633-e7d8-4f7d-92f7-aab9202f16b6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:05.778815 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-184f0633-e7d8-4f7d-92f7-aab9202f16b6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:05.779646 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-184f0633-e7d8-4f7d-92f7-aab9202f16b6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:05.780288 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-184f0633-e7d8-4f7d-92f7-aab9202f16b6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:05.798833 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-184f0633-e7d8-4f7d-92f7-aab9202f16b6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] HTTP exception thrown: Instance ce0dadb5-652d-42b9-90aa-461f74d68dca could not be found. Jun 24 09:45:05.801279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-184f0633-e7d8-4f7d-92f7-aab9202f16b6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Request method failure captured: Jun 24 09:45:05.801279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca HTTP/1.1 Jun 24 09:45:05.801279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:45:05.801279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:45:05.801279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:45:05.801279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:45:05.801279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:45:05.801279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:45:05.801279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:45:05.801279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:45:05.801279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYcxwGXEovy-LGVwp4qX64FQhGvHGFsEZW4zChV_HUAM-YiOamDTzYYgumJBSLkR-jla0pvJWTJeWzmeCkUAK_6asCf-dePlKoSzD2y8A1P1OfDmzeMH3VDLANCtrB9eaBHijbtczNcE_ybKwiC1TXlu--9pkGeIW6UfmHlYAKJe_a8 Jun 24 09:45:05.801279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:45:05.801279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:45:05.801279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:45:05.801279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:45:05.801279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:45:05.801279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:45:05.801279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 2b043de82f1b43f78e3b92d375111d91 Jun 24 09:45:05.801279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1617955141 Jun 24 09:45:05.801279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:45:05.801279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:45:05.802546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2b043de82f1b43f78e3b92d375111d91", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2b043de82f1b43f78e3b92d375111d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2b043de82f1b43f78e3b92d375111d91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2b043de82f1b43f78e3b92d375111d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:45:05.802546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-VolumesSnapshotTestJSON-1617955141 Jun 24 09:45:05.802546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 2b043de82f1b43f78e3b92d375111d91 Jun 24 09:45:05.802546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1617955141 Jun 24 09:45:05.802546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-VolumesSnapshotTestJSON-1617955141-project Jun 24 09:45:05.802546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:45:05.802546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:45:05.802546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: 7f8df9faa4dd4eeeb724e891cdb55616 Jun 24 09:45:05.802546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-VolumesSnapshotTestJSON-1617955141-project Jun 24 09:45:05.802546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:45:05.802546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance ce0dadb5-652d-42b9-90aa-461f74d68dca could not be found. Jun 24 09:45:05.802546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': 'ce0dadb5-652d-42b9-90aa-461f74d68dca'} Jun 24 09:45:05.803290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:45:05.803290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:45:05.803290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:45:05.803290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:45:05.803290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:45:05.803290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:45:05.803290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:45:05.803290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:45:05.803290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:45:05.803290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:45:05.803290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce0dadb5-652d-42b9-90aa-461f74d68dca could not be found. Jun 24 09:45:05.803290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:45:05.803290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:45:05.803290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:45:05.803290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:45:05.803290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:45:05.803290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:45:05.803290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:45:05.803290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:45:05.803290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:45:05.805157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:45:05.805157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:45:05.805157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:45:05.805157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:45:05.805157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:45:05.805157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:45:05.805157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:45:05.805157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce0dadb5-652d-42b9-90aa-461f74d68dca could not be found. Jun 24 09:45:05.805157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:45:05.805157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:45:05.805157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:45:05.805157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:45:05.805157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:45:05.805157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:45:05.805157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:45:05.805157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:45:05.805157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce0dadb5-652d-42b9-90aa-461f74d68dca could not be found. Jun 24 09:45:05.805157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:45:05.806179 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-184f0633-e7d8-4f7d-92f7-aab9202f16b6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Returning 404 to user: Instance ce0dadb5-652d-42b9-90aa-461f74d68dca could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:45:05.806179 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-184f0633-e7d8-4f7d-92f7-aab9202f16b6 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca" status: 404 len: 111 microversion: 2.1 time: 0.040685 Jun 24 09:45:05.806179 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 196/381] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:05 2022] GET /compute/v2.1/servers/ce0dadb5-652d-42b9-90aa-461f74d68dca => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:45:06.353652 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-f7d09f59-cd7a-41d6-98b2-be982df6cb0c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:06.354752 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-f7d09f59-cd7a-41d6-98b2-be982df6cb0c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:06.378954 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f7d09f59-cd7a-41d6-98b2-be982df6cb0c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:06.379534 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f7d09f59-cd7a-41d6-98b2-be982df6cb0c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:06.380367 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f7d09f59-cd7a-41d6-98b2-be982df6cb0c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:06.380843 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f7d09f59-cd7a-41d6-98b2-be982df6cb0c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:06.541142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f7d09f59-cd7a-41d6-98b2-be982df6cb0c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:06.549959 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f7d09f59-cd7a-41d6-98b2-be982df6cb0c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:06.551474 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f7d09f59-cd7a-41d6-98b2-be982df6cb0c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:06.552626 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-f7d09f59-cd7a-41d6-98b2-be982df6cb0c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1749 microversion: 2.20 time: 0.245411 Jun 24 09:45:06.563636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 186/382] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:06 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1749 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:06.965044 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e21a0b99-0ffe-4e80-9d50-c1e86ba74e06 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Action: 'create', calling method: .version_select at 0x7fc6d462d670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-747705025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlF4PzxoA4/nXsQox2Lr4BJNWO1ZNvLM1mOjP3cnoqfIwgkuOb3zOoO/N9JXcBv7m6aSf5XvyHeqRf/qmejMOnNYIakwB2rBXtVFMRAe4t3Csrpl11G8rJkDeWsDkVXXA=="}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:06.969647 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:06.982505 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-e21a0b99-0ffe-4e80-9d50-c1e86ba74e06 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Getting quotas for project a0aff51028ec477ebbc12e078174977a. Resources: {'key_pairs'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:45:06.986493 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-e21a0b99-0ffe-4e80-9d50-c1e86ba74e06 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Getting quotas for user 1636311c73b9461c9a64db18e8fdf0a3 and project a0aff51028ec477ebbc12e078174977a. Resources: {'key_pairs'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:45:07.010285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e21a0b99-0ffe-4e80-9d50-c1e86ba74e06 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049150 Jun 24 09:45:07.011260 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 197/383] 10.222.0.65 () {60 vars in 1158 bytes} [Fri Jun 24 09:45:06 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:45:07.064687 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-0fa744d8-d6dd-4df1-bb4a-e603f0881320 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1879654117", "imageRef": "2c5ad322-dbb7-4a65-9b8b-78d8f6672fa6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-747705025", "networks": [{"uuid": "81ccbe4d-d281-46f1-a767-e183ccaac7bb"}]}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:07.119843 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.network.neutron [None req-0fa744d8-d6dd-4df1-bb4a-e603f0881320 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] validate_networks() for [('81ccbe4d-d281-46f1-a767-e183ccaac7bb', None, None, None, None, None)] {{(pid=124338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:45:07.560707 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-0fa744d8-d6dd-4df1-bb4a-e603f0881320 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Flavor limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:45:07.561383 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-0fa744d8-d6dd-4df1-bb4a-e603f0881320 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Image limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:45:07.561744 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-0fa744d8-d6dd-4df1-bb4a-e603f0881320 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Flavor pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:45:07.562214 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-0fa744d8-d6dd-4df1-bb4a-e603f0881320 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Image pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:45:07.562736 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-0fa744d8-d6dd-4df1-bb4a-e603f0881320 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:45:07.572415 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-6541c6a5-0afe-485f-a2ab-dc30923fdd98 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:07.573166 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-6541c6a5-0afe-485f-a2ab-dc30923fdd98 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:07.573480 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0fa744d8-d6dd-4df1-bb4a-e603f0881320 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:07.574013 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0fa744d8-d6dd-4df1-bb4a-e603f0881320 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:07.574872 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0fa744d8-d6dd-4df1-bb4a-e603f0881320 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:07.575417 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0fa744d8-d6dd-4df1-bb4a-e603f0881320 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:07.579625 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6541c6a5-0afe-485f-a2ab-dc30923fdd98 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:07.580411 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6541c6a5-0afe-485f-a2ab-dc30923fdd98 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:07.581537 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6541c6a5-0afe-485f-a2ab-dc30923fdd98 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:07.581976 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6541c6a5-0afe-485f-a2ab-dc30923fdd98 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:07.593781 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-0fa744d8-d6dd-4df1-bb4a-e603f0881320 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Getting quotas for project a0aff51028ec477ebbc12e078174977a. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:45:07.599391 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-0fa744d8-d6dd-4df1-bb4a-e603f0881320 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Getting quotas for user 1636311c73b9461c9a64db18e8fdf0a3 and project a0aff51028ec477ebbc12e078174977a. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:45:07.613383 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-0fa744d8-d6dd-4df1-bb4a-e603f0881320 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Going to run 1 instances... {{(pid=124338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:45:07.615578 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-0fa744d8-d6dd-4df1-bb4a-e603f0881320 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c5ad322-dbb7-4a65-9b8b-78d8f6672fa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:45:07.666919 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-0fa744d8-d6dd-4df1-bb4a-e603f0881320 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606141 Jun 24 09:45:07.672959 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 187/384] 10.222.0.65 () {60 vars in 1146 bytes} [Fri Jun 24 09:45:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 09:45:07.678757 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-a1aa4dcb-1933-40f6-97ad-1354248c416c tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:07.679373 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-a1aa4dcb-1933-40f6-97ad-1354248c416c tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:07.755122 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-a1aa4dcb-1933-40f6-97ad-1354248c416c tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:07.758187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6541c6a5-0afe-485f-a2ab-dc30923fdd98 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:07.764214 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-a1aa4dcb-1933-40f6-97ad-1354248c416c tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1258 microversion: 2.1 time: 0.089337 Jun 24 09:45:07.765311 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 188/385] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:07 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1258 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:45:07.767274 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6541c6a5-0afe-485f-a2ab-dc30923fdd98 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:07.768781 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6541c6a5-0afe-485f-a2ab-dc30923fdd98 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:07.769993 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-6541c6a5-0afe-485f-a2ab-dc30923fdd98 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1749 microversion: 2.20 time: 0.201989 Jun 24 09:45:07.770732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 198/386] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:07 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1749 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:08.782217 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-2778f423-d4a7-4be6-ab6b-4dfeb47e348a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:08.782818 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-2778f423-d4a7-4be6-ab6b-4dfeb47e348a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:08.788761 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-683bc715-59af-40f0-8a45-d38c4c527142 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:08.789374 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-683bc715-59af-40f0-8a45-d38c4c527142 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:08.790099 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2778f423-d4a7-4be6-ab6b-4dfeb47e348a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:08.790545 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2778f423-d4a7-4be6-ab6b-4dfeb47e348a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:08.791361 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2778f423-d4a7-4be6-ab6b-4dfeb47e348a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:08.791798 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2778f423-d4a7-4be6-ab6b-4dfeb47e348a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:08.796123 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-683bc715-59af-40f0-8a45-d38c4c527142 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:08.796576 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-683bc715-59af-40f0-8a45-d38c4c527142 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:08.797608 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-683bc715-59af-40f0-8a45-d38c4c527142 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:08.797802 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-683bc715-59af-40f0-8a45-d38c4c527142 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:08.862960 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-2778f423-d4a7-4be6-ab6b-4dfeb47e348a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:08.872019 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-2778f423-d4a7-4be6-ab6b-4dfeb47e348a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1262 microversion: 2.1 time: 0.093789 Jun 24 09:45:08.872606 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 189/387] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:08 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:08.947224 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-683bc715-59af-40f0-8a45-d38c4c527142 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:08.957713 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-683bc715-59af-40f0-8a45-d38c4c527142 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:08.959246 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-683bc715-59af-40f0-8a45-d38c4c527142 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:08.960417 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-683bc715-59af-40f0-8a45-d38c4c527142 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1749 microversion: 2.20 time: 0.175637 Jun 24 09:45:08.960948 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 199/388] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:08 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1749 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:09.889727 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-e3517dac-0c1f-4e16-9503-816e52d4f166 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:09.890370 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-e3517dac-0c1f-4e16-9503-816e52d4f166 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:09.897566 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e3517dac-0c1f-4e16-9503-816e52d4f166 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:09.898017 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e3517dac-0c1f-4e16-9503-816e52d4f166 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:09.898800 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e3517dac-0c1f-4e16-9503-816e52d4f166 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:09.899266 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e3517dac-0c1f-4e16-9503-816e52d4f166 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:09.979463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-6e51ce9d-33dc-4bf3-8c6b-d2c216cd96c6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:09.980077 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-6e51ce9d-33dc-4bf3-8c6b-d2c216cd96c6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:09.981173 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-e3517dac-0c1f-4e16-9503-816e52d4f166 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:09.989185 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6e51ce9d-33dc-4bf3-8c6b-d2c216cd96c6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:09.990141 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6e51ce9d-33dc-4bf3-8c6b-d2c216cd96c6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:09.991357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6e51ce9d-33dc-4bf3-8c6b-d2c216cd96c6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:09.992150 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6e51ce9d-33dc-4bf3-8c6b-d2c216cd96c6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:10.006350 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-e3517dac-0c1f-4e16-9503-816e52d4f166 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1318 microversion: 2.1 time: 0.119355 Jun 24 09:45:10.007029 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 190/389] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:09 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1318 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:10.154787 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6e51ce9d-33dc-4bf3-8c6b-d2c216cd96c6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:10.164761 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6e51ce9d-33dc-4bf3-8c6b-d2c216cd96c6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:10.166625 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6e51ce9d-33dc-4bf3-8c6b-d2c216cd96c6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:10.177446 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-6e51ce9d-33dc-4bf3-8c6b-d2c216cd96c6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1751 microversion: 2.20 time: 0.194118 Jun 24 09:45:10.178208 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 200/390] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:09 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1751 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:45:11.024107 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-f6f0b36d-5c06-44f6-ac68-887fb8308d0d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:11.025424 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-f6f0b36d-5c06-44f6-ac68-887fb8308d0d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:11.033959 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f6f0b36d-5c06-44f6-ac68-887fb8308d0d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:11.034786 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f6f0b36d-5c06-44f6-ac68-887fb8308d0d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:11.035938 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f6f0b36d-5c06-44f6-ac68-887fb8308d0d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:11.036578 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f6f0b36d-5c06-44f6-ac68-887fb8308d0d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:11.198355 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-785dc91a-8345-4ad3-82d7-7f0bf1598220 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:11.199623 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-785dc91a-8345-4ad3-82d7-7f0bf1598220 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:11.216858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-785dc91a-8345-4ad3-82d7-7f0bf1598220 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:11.217631 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-785dc91a-8345-4ad3-82d7-7f0bf1598220 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:11.218700 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-785dc91a-8345-4ad3-82d7-7f0bf1598220 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:11.219302 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-785dc91a-8345-4ad3-82d7-7f0bf1598220 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:11.408326 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f6f0b36d-5c06-44f6-ac68-887fb8308d0d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:11.422620 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-f6f0b36d-5c06-44f6-ac68-887fb8308d0d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.402591 Jun 24 09:45:11.423876 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 191/391] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:11 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:11.433886 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-785dc91a-8345-4ad3-82d7-7f0bf1598220 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:11.445643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-785dc91a-8345-4ad3-82d7-7f0bf1598220 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:11.447638 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-785dc91a-8345-4ad3-82d7-7f0bf1598220 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:11.449330 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-785dc91a-8345-4ad3-82d7-7f0bf1598220 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.255363 Jun 24 09:45:11.449895 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 201/392] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:11 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:45:12.440867 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-d9c28a8d-1f10-4e57-8c2f-b8063a80ee5e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:12.442241 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-d9c28a8d-1f10-4e57-8c2f-b8063a80ee5e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:12.449953 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d9c28a8d-1f10-4e57-8c2f-b8063a80ee5e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:12.450947 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d9c28a8d-1f10-4e57-8c2f-b8063a80ee5e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:12.452026 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d9c28a8d-1f10-4e57-8c2f-b8063a80ee5e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:12.452635 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d9c28a8d-1f10-4e57-8c2f-b8063a80ee5e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:12.467878 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1e569a9c-e5fc-4d48-89d0-487d08e7fe16 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:12.468417 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-1e569a9c-e5fc-4d48-89d0-487d08e7fe16 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:12.475440 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1e569a9c-e5fc-4d48-89d0-487d08e7fe16 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:12.476135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1e569a9c-e5fc-4d48-89d0-487d08e7fe16 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:12.477251 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1e569a9c-e5fc-4d48-89d0-487d08e7fe16 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:12.477666 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1e569a9c-e5fc-4d48-89d0-487d08e7fe16 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:12.637552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d9c28a8d-1f10-4e57-8c2f-b8063a80ee5e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:12.647090 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-d9c28a8d-1f10-4e57-8c2f-b8063a80ee5e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.210524 Jun 24 09:45:12.647785 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 192/393] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:12 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:12.682012 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-1e569a9c-e5fc-4d48-89d0-487d08e7fe16 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:12.692192 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-1e569a9c-e5fc-4d48-89d0-487d08e7fe16 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:12.693936 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-1e569a9c-e5fc-4d48-89d0-487d08e7fe16 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:12.695565 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-1e569a9c-e5fc-4d48-89d0-487d08e7fe16 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.231622 Jun 24 09:45:12.696306 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 202/394] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:12 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:13.664281 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-6e706a37-3172-4da4-b7c0-9cf57ffe5ba0 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:13.664877 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-6e706a37-3172-4da4-b7c0-9cf57ffe5ba0 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:13.679562 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6e706a37-3172-4da4-b7c0-9cf57ffe5ba0 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:13.680355 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6e706a37-3172-4da4-b7c0-9cf57ffe5ba0 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:13.681359 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6e706a37-3172-4da4-b7c0-9cf57ffe5ba0 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:13.681797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6e706a37-3172-4da4-b7c0-9cf57ffe5ba0 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:13.714771 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-49620bf4-c465-49c4-bb8e-6ad274d316e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:13.715695 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-49620bf4-c465-49c4-bb8e-6ad274d316e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:13.724215 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-49620bf4-c465-49c4-bb8e-6ad274d316e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:13.725190 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-49620bf4-c465-49c4-bb8e-6ad274d316e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:13.726078 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-49620bf4-c465-49c4-bb8e-6ad274d316e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:13.726856 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-49620bf4-c465-49c4-bb8e-6ad274d316e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:13.751997 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:13.889380 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-6e706a37-3172-4da4-b7c0-9cf57ffe5ba0 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:13.899092 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-6e706a37-3172-4da4-b7c0-9cf57ffe5ba0 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.238805 Jun 24 09:45:13.909690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 193/395] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:13 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:13.916404 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-49620bf4-c465-49c4-bb8e-6ad274d316e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:13.925762 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-49620bf4-c465-49c4-bb8e-6ad274d316e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:13.927425 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-49620bf4-c465-49c4-bb8e-6ad274d316e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:13.928965 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-49620bf4-c465-49c4-bb8e-6ad274d316e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.218911 Jun 24 09:45:13.929535 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 203/396] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:13 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:45:14.921347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-539af41b-fdb9-4013-8d33-e7a5ecadeac2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:14.921995 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-539af41b-fdb9-4013-8d33-e7a5ecadeac2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:14.929248 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-539af41b-fdb9-4013-8d33-e7a5ecadeac2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:14.929615 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-539af41b-fdb9-4013-8d33-e7a5ecadeac2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:14.930380 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-539af41b-fdb9-4013-8d33-e7a5ecadeac2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:14.930850 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-539af41b-fdb9-4013-8d33-e7a5ecadeac2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:14.948186 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e9da6d8c-04d6-4c9f-9a68-b1723af17965 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:14.948910 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e9da6d8c-04d6-4c9f-9a68-b1723af17965 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:14.955772 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e9da6d8c-04d6-4c9f-9a68-b1723af17965 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:14.956552 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e9da6d8c-04d6-4c9f-9a68-b1723af17965 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:14.957397 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e9da6d8c-04d6-4c9f-9a68-b1723af17965 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:14.957902 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e9da6d8c-04d6-4c9f-9a68-b1723af17965 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:15.155251 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-539af41b-fdb9-4013-8d33-e7a5ecadeac2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:15.160186 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e9da6d8c-04d6-4c9f-9a68-b1723af17965 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:15.168942 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-539af41b-fdb9-4013-8d33-e7a5ecadeac2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.254218 Jun 24 09:45:15.171605 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e9da6d8c-04d6-4c9f-9a68-b1723af17965 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:15.173870 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e9da6d8c-04d6-4c9f-9a68-b1723af17965 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:15.175452 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 194/397] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:14 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:15.176826 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e9da6d8c-04d6-4c9f-9a68-b1723af17965 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.232387 Jun 24 09:45:15.177571 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 204/398] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:14 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:16.046348 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-8e2dad45-bc3b-41f6-942d-8bf071ccbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1619666209", "imageRef": "844ad823-18a2-4abc-813c-2d1825141591", "flavorRef": "452", "networks": [{"uuid": "c876540d-f69d-4345-8da3-6262b1921560"}]}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:16.102486 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.network.neutron [None req-8e2dad45-bc3b-41f6-942d-8bf071ccbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] validate_networks() for [('c876540d-f69d-4345-8da3-6262b1921560', None, None, None, None, None)] {{(pid=124338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:45:16.187188 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-8e8b681b-3094-4064-9aa8-98179e1e6579 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:16.187848 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-8e8b681b-3094-4064-9aa8-98179e1e6579 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:16.195121 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8e8b681b-3094-4064-9aa8-98179e1e6579 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:16.195567 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8e8b681b-3094-4064-9aa8-98179e1e6579 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:16.196325 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8e8b681b-3094-4064-9aa8-98179e1e6579 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:16.196754 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8e8b681b-3094-4064-9aa8-98179e1e6579 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:16.662499 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-8e8b681b-3094-4064-9aa8-98179e1e6579 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:16.670214 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-8e8b681b-3094-4064-9aa8-98179e1e6579 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.486963 Jun 24 09:45:16.670780 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 205/399] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:16 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:16.675627 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b38b774c-e205-4804-8b11-3b0aadca6b31 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:16.676522 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-b38b774c-e205-4804-8b11-3b0aadca6b31 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:16.682395 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b38b774c-e205-4804-8b11-3b0aadca6b31 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:16.682864 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b38b774c-e205-4804-8b11-3b0aadca6b31 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:16.683738 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b38b774c-e205-4804-8b11-3b0aadca6b31 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:16.684166 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b38b774c-e205-4804-8b11-3b0aadca6b31 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:16.849621 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-8e2dad45-bc3b-41f6-942d-8bf071ccbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Flavor limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:45:16.850316 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-8e2dad45-bc3b-41f6-942d-8bf071ccbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Image limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:45:16.850815 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-8e2dad45-bc3b-41f6-942d-8bf071ccbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Flavor pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:45:16.851832 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-8e2dad45-bc3b-41f6-942d-8bf071ccbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Image pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:45:16.852382 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-8e2dad45-bc3b-41f6-942d-8bf071ccbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:45:16.862477 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8e2dad45-bc3b-41f6-942d-8bf071ccbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:16.863735 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8e2dad45-bc3b-41f6-942d-8bf071ccbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:16.864953 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8e2dad45-bc3b-41f6-942d-8bf071ccbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:16.865621 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8e2dad45-bc3b-41f6-942d-8bf071ccbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:16.885454 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b38b774c-e205-4804-8b11-3b0aadca6b31 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:16.886805 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-8e2dad45-bc3b-41f6-942d-8bf071ccbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Getting quotas for project 2b043de82f1b43f78e3b92d375111d91. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:45:16.891176 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-8e2dad45-bc3b-41f6-942d-8bf071ccbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Getting quotas for user 7f8df9faa4dd4eeeb724e891cdb55616 and project 2b043de82f1b43f78e3b92d375111d91. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:45:16.895663 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b38b774c-e205-4804-8b11-3b0aadca6b31 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:16.897238 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b38b774c-e205-4804-8b11-3b0aadca6b31 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:16.898607 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b38b774c-e205-4804-8b11-3b0aadca6b31 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.226830 Jun 24 09:45:16.903122 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 206/400] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:16 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:16.904228 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-8e2dad45-bc3b-41f6-942d-8bf071ccbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Going to run 1 instances... {{(pid=124338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:45:16.906619 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-8e2dad45-bc3b-41f6-942d-8bf071ccbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='844ad823-18a2-4abc-813c-2d1825141591',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:45:16.951386 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-8e2dad45-bc3b-41f6-942d-8bf071ccbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908935 Jun 24 09:45:16.952152 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 195/401] 10.222.0.65 () {60 vars in 1146 bytes} [Fri Jun 24 09:45:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 09:45:16.962521 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-ff0d949c-9bfe-4ca8-9a11-aeb0b1d8631c tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:16.963129 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-ff0d949c-9bfe-4ca8-9a11-aeb0b1d8631c tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:17.000054 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=4 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:17.023243 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ff0d949c-9bfe-4ca8-9a11-aeb0b1d8631c tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:17.030155 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-ff0d949c-9bfe-4ca8-9a11-aeb0b1d8631c tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1219 microversion: 2.1 time: 0.071765 Jun 24 09:45:17.030835 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 207/402] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:16 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:17.688974 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-e730db06-749e-4f47-81a3-1078c0ceccff tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:17.689627 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-e730db06-749e-4f47-81a3-1078c0ceccff tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:17.696944 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e730db06-749e-4f47-81a3-1078c0ceccff tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:17.697395 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e730db06-749e-4f47-81a3-1078c0ceccff tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:17.698170 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e730db06-749e-4f47-81a3-1078c0ceccff tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:17.698600 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e730db06-749e-4f47-81a3-1078c0ceccff tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:17.846355 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-e730db06-749e-4f47-81a3-1078c0ceccff tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:17.862450 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-e730db06-749e-4f47-81a3-1078c0ceccff tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.178011 Jun 24 09:45:17.863567 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 196/403] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:17 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:17.917397 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-37e2bc83-1ed8-41e8-8e83-869ea3b77ccb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:17.917999 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-37e2bc83-1ed8-41e8-8e83-869ea3b77ccb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:17.925171 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-37e2bc83-1ed8-41e8-8e83-869ea3b77ccb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:17.925629 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-37e2bc83-1ed8-41e8-8e83-869ea3b77ccb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:17.926403 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-37e2bc83-1ed8-41e8-8e83-869ea3b77ccb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:17.926857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-37e2bc83-1ed8-41e8-8e83-869ea3b77ccb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:18.048179 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-89349ca8-8764-4f83-a39e-2cb1e88c3e1b tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:18.049179 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-89349ca8-8764-4f83-a39e-2cb1e88c3e1b tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:18.056657 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-89349ca8-8764-4f83-a39e-2cb1e88c3e1b tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:18.057085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-89349ca8-8764-4f83-a39e-2cb1e88c3e1b tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:18.057866 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-89349ca8-8764-4f83-a39e-2cb1e88c3e1b tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:18.058299 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-89349ca8-8764-4f83-a39e-2cb1e88c3e1b tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:18.104136 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-37e2bc83-1ed8-41e8-8e83-869ea3b77ccb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:18.113606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-37e2bc83-1ed8-41e8-8e83-869ea3b77ccb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:18.115267 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-37e2bc83-1ed8-41e8-8e83-869ea3b77ccb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:18.116565 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-37e2bc83-1ed8-41e8-8e83-869ea3b77ccb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.203185 Jun 24 09:45:18.117394 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 208/404] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:17 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:18.126528 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-89349ca8-8764-4f83-a39e-2cb1e88c3e1b tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:18.135699 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-89349ca8-8764-4f83-a39e-2cb1e88c3e1b tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1223 microversion: 2.1 time: 0.091778 Jun 24 09:45:18.136385 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 197/405] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:18 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:18.879461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c15ad26e-b466-4d9d-9c57-d801e80a1f2e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:18.879986 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-c15ad26e-b466-4d9d-9c57-d801e80a1f2e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:18.886664 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c15ad26e-b466-4d9d-9c57-d801e80a1f2e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:18.887109 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c15ad26e-b466-4d9d-9c57-d801e80a1f2e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:18.887913 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c15ad26e-b466-4d9d-9c57-d801e80a1f2e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:18.888354 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c15ad26e-b466-4d9d-9c57-d801e80a1f2e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:18.913549 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-82e9b047-5abc-457b-8297-e2449783ac7c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c34544f-fdf0-4051-a160-0d7e3da44272"}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:18.914741 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-82e9b047-5abc-457b-8297-e2449783ac7c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:18.921498 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-82e9b047-5abc-457b-8297-e2449783ac7c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:18.921952 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-82e9b047-5abc-457b-8297-e2449783ac7c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:18.922731 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-82e9b047-5abc-457b-8297-e2449783ac7c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:18.923266 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-82e9b047-5abc-457b-8297-e2449783ac7c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:19.024891 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c15ad26e-b466-4d9d-9c57-d801e80a1f2e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:19.032589 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-c15ad26e-b466-4d9d-9c57-d801e80a1f2e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.157503 Jun 24 09:45:19.033161 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 209/406] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:18 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:19.135836 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-087190fe-edd8-4851-819e-fe5202112adb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:19.136356 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-087190fe-edd8-4851-819e-fe5202112adb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:19.151234 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-087190fe-edd8-4851-819e-fe5202112adb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:19.151844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-087190fe-edd8-4851-819e-fe5202112adb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:19.152724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-087190fe-edd8-4851-819e-fe5202112adb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:19.153258 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-087190fe-edd8-4851-819e-fe5202112adb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:19.301135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-087190fe-edd8-4851-819e-fe5202112adb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:19.313801 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-087190fe-edd8-4851-819e-fe5202112adb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:19.316079 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-087190fe-edd8-4851-819e-fe5202112adb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:19.317695 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-087190fe-edd8-4851-819e-fe5202112adb tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.185982 Jun 24 09:45:19.318261 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 210/407] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:19 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:45:19.322915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3e9e8413-781f-478b-a172-dca461b4b819 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:19.323894 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3e9e8413-781f-478b-a172-dca461b4b819 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:19.331196 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3e9e8413-781f-478b-a172-dca461b4b819 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:19.332174 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3e9e8413-781f-478b-a172-dca461b4b819 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:19.333345 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3e9e8413-781f-478b-a172-dca461b4b819 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:19.333777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3e9e8413-781f-478b-a172-dca461b4b819 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:19.404116 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3e9e8413-781f-478b-a172-dca461b4b819 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:19.411982 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3e9e8413-781f-478b-a172-dca461b4b819 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1223 microversion: 2.1 time: 0.092447 Jun 24 09:45:19.412801 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 211/408] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:19 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:20.050226 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-21d995c7-01cb-431f-971a-f82307974c13 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:20.050981 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-21d995c7-01cb-431f-971a-f82307974c13 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:20.057908 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-21d995c7-01cb-431f-971a-f82307974c13 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:20.058356 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-21d995c7-01cb-431f-971a-f82307974c13 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:20.059128 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-21d995c7-01cb-431f-971a-f82307974c13 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:20.059588 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-21d995c7-01cb-431f-971a-f82307974c13 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:20.198465 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-21d995c7-01cb-431f-971a-f82307974c13 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:20.206050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-21d995c7-01cb-431f-971a-f82307974c13 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.159869 Jun 24 09:45:20.206688 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 212/409] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:20 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:20.336586 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4bc9b301-29cf-4541-8840-0c990173894e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:20.337115 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-4bc9b301-29cf-4541-8840-0c990173894e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:20.343784 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4bc9b301-29cf-4541-8840-0c990173894e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:20.344236 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4bc9b301-29cf-4541-8840-0c990173894e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:20.345002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4bc9b301-29cf-4541-8840-0c990173894e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:20.345437 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4bc9b301-29cf-4541-8840-0c990173894e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:20.487672 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4bc9b301-29cf-4541-8840-0c990173894e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:20.497516 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4bc9b301-29cf-4541-8840-0c990173894e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:20.499307 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4bc9b301-29cf-4541-8840-0c990173894e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:20.500597 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-4bc9b301-29cf-4541-8840-0c990173894e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.168144 Jun 24 09:45:20.501206 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 213/410] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:20 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:20.506615 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4e36f814-7b51-4a64-be78-637f5f07c2a9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:20.507271 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-4e36f814-7b51-4a64-be78-637f5f07c2a9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:20.514338 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4e36f814-7b51-4a64-be78-637f5f07c2a9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:20.514787 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4e36f814-7b51-4a64-be78-637f5f07c2a9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:20.515622 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4e36f814-7b51-4a64-be78-637f5f07c2a9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:20.516057 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4e36f814-7b51-4a64-be78-637f5f07c2a9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:20.577863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4e36f814-7b51-4a64-be78-637f5f07c2a9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:20.586209 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-4e36f814-7b51-4a64-be78-637f5f07c2a9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1223 microversion: 2.1 time: 0.083812 Jun 24 09:45:20.586878 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 214/411] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:20 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:20.671380 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:20.876970 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-82e9b047-5abc-457b-8297-e2449783ac7c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "POST /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.967471 Jun 24 09:45:20.877627 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 198/412] 10.222.0.65 () {60 vars in 1322 bytes} [Fri Jun 24 09:45:18 2022] POST /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/os-volume_attachments => generated 194 bytes in 1969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:45:21.234763 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-9be6c187-993e-435c-a9d5-27c4e4ef38e9 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:21.235477 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-9be6c187-993e-435c-a9d5-27c4e4ef38e9 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:21.254452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9be6c187-993e-435c-a9d5-27c4e4ef38e9 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:21.257153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9be6c187-993e-435c-a9d5-27c4e4ef38e9 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:21.258096 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9be6c187-993e-435c-a9d5-27c4e4ef38e9 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:21.259493 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9be6c187-993e-435c-a9d5-27c4e4ef38e9 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:21.400471 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-31a0c904-6c67-4787-a175-ac55d8629fe6 req-e2e3f3e3-a254-4096-b234-ac3f396693f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d874254-475b-4025-8b67-b4af897fdb60", "tag": "de309464-eb94-4c38-b29b-c293a12d68b1"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:21.429190 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-31a0c904-6c67-4787-a175-ac55d8629fe6 req-e2e3f3e3-a254-4096-b234-ac3f396693f0 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:21.429190 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-31a0c904-6c67-4787-a175-ac55d8629fe6 req-e2e3f3e3-a254-4096-b234-ac3f396693f0 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:21.453877 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-31a0c904-6c67-4787-a175-ac55d8629fe6 req-e2e3f3e3-a254-4096-b234-ac3f396693f0 service nova] Creating event network-changed:de309464-eb94-4c38-b29b-c293a12d68b1 for instance 0d874254-475b-4025-8b67-b4af897fdb60 on hv-cinder-80382 Jun 24 09:45:21.459511 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-31a0c904-6c67-4787-a175-ac55d8629fe6 req-e2e3f3e3-a254-4096-b234-ac3f396693f0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070016 Jun 24 09:45:21.464158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 199/413] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:45:21.522166 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-fc82f204-7300-4876-853d-b14f69507e9a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:21.523236 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-fc82f204-7300-4876-853d-b14f69507e9a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:21.534879 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fc82f204-7300-4876-853d-b14f69507e9a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:21.536161 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fc82f204-7300-4876-853d-b14f69507e9a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:21.537112 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fc82f204-7300-4876-853d-b14f69507e9a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:21.537688 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fc82f204-7300-4876-853d-b14f69507e9a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:21.632958 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-9be6c187-993e-435c-a9d5-27c4e4ef38e9 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:21.640941 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-9be6c187-993e-435c-a9d5-27c4e4ef38e9 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.414738 Jun 24 09:45:21.643440 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 215/414] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:21 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:21.655002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-d53b693a-33dc-4b42-b551-b68cc6f4ed5e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:21.655686 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-d53b693a-33dc-4b42-b551-b68cc6f4ed5e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:21.673187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d53b693a-33dc-4b42-b551-b68cc6f4ed5e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:21.673575 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d53b693a-33dc-4b42-b551-b68cc6f4ed5e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:21.674399 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d53b693a-33dc-4b42-b551-b68cc6f4ed5e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:21.674819 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d53b693a-33dc-4b42-b551-b68cc6f4ed5e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:21.805806 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-d53b693a-33dc-4b42-b551-b68cc6f4ed5e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:21.814956 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-d53b693a-33dc-4b42-b551-b68cc6f4ed5e tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1277 microversion: 2.1 time: 0.170202 Jun 24 09:45:21.816235 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 216/415] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:21 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:21.947456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-fc82f204-7300-4876-853d-b14f69507e9a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:21.958220 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-fc82f204-7300-4876-853d-b14f69507e9a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:21.960126 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-fc82f204-7300-4876-853d-b14f69507e9a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:21.961354 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-fc82f204-7300-4876-853d-b14f69507e9a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.444812 Jun 24 09:45:21.962085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 200/416] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:21 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:22.662238 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b2285482-f107-4304-9c39-f07b3e0780e8 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:22.662930 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-b2285482-f107-4304-9c39-f07b3e0780e8 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:22.677038 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b2285482-f107-4304-9c39-f07b3e0780e8 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:22.677513 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b2285482-f107-4304-9c39-f07b3e0780e8 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:22.679228 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b2285482-f107-4304-9c39-f07b3e0780e8 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:22.679661 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b2285482-f107-4304-9c39-f07b3e0780e8 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:22.831376 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b2285482-f107-4304-9c39-f07b3e0780e8 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:22.832296 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-83907b11-4cc6-4be8-8a72-b6d6553cc298 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:22.832935 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-83907b11-4cc6-4be8-8a72-b6d6553cc298 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:22.839590 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-83907b11-4cc6-4be8-8a72-b6d6553cc298 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:22.840040 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-83907b11-4cc6-4be8-8a72-b6d6553cc298 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:22.840817 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-83907b11-4cc6-4be8-8a72-b6d6553cc298 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:22.841255 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-83907b11-4cc6-4be8-8a72-b6d6553cc298 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:22.852151 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b2285482-f107-4304-9c39-f07b3e0780e8 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.194871 Jun 24 09:45:22.853612 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 217/417] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:22 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:22.981279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-6eb4485d-f235-4654-8286-f7e66110bff1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:22.981963 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-6eb4485d-f235-4654-8286-f7e66110bff1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:22.988734 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6eb4485d-f235-4654-8286-f7e66110bff1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:22.989275 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6eb4485d-f235-4654-8286-f7e66110bff1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:22.990283 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6eb4485d-f235-4654-8286-f7e66110bff1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:22.990692 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6eb4485d-f235-4654-8286-f7e66110bff1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:23.216296 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-83907b11-4cc6-4be8-8a72-b6d6553cc298 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:23.224660 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-83907b11-4cc6-4be8-8a72-b6d6553cc298 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.396138 Jun 24 09:45:23.232122 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 201/418] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:22 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:45:23.390889 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6eb4485d-f235-4654-8286-f7e66110bff1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:23.413821 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6eb4485d-f235-4654-8286-f7e66110bff1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:23.417943 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6eb4485d-f235-4654-8286-f7e66110bff1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:23.420793 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-6eb4485d-f235-4654-8286-f7e66110bff1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.443605 Jun 24 09:45:23.421934 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 218/419] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:22 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:23.870552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7035c394-df83-4aba-9a86-beba2862e671 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:23.871787 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-7035c394-df83-4aba-9a86-beba2862e671 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:23.883019 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7035c394-df83-4aba-9a86-beba2862e671 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:23.885032 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7035c394-df83-4aba-9a86-beba2862e671 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:23.887046 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7035c394-df83-4aba-9a86-beba2862e671 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:23.891009 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7035c394-df83-4aba-9a86-beba2862e671 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:24.242467 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-fd4612db-afcb-4328-ab41-de27b09b7342 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:24.243196 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-fd4612db-afcb-4328-ab41-de27b09b7342 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:24.256136 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fd4612db-afcb-4328-ab41-de27b09b7342 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:24.257499 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fd4612db-afcb-4328-ab41-de27b09b7342 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:24.258466 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fd4612db-afcb-4328-ab41-de27b09b7342 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:24.259047 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fd4612db-afcb-4328-ab41-de27b09b7342 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:24.670073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-7035c394-df83-4aba-9a86-beba2862e671 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:24.682429 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-7035c394-df83-4aba-9a86-beba2862e671 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.816602 Jun 24 09:45:24.684752 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 202/420] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:23 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:24.696392 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-8e8fa7b8-5e38-495d-886c-c0213c996227 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:24.697274 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-8e8fa7b8-5e38-495d-886c-c0213c996227 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:24.716476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8e8fa7b8-5e38-495d-886c-c0213c996227 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:24.717300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8e8fa7b8-5e38-495d-886c-c0213c996227 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:24.718332 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8e8fa7b8-5e38-495d-886c-c0213c996227 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:24.718912 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8e8fa7b8-5e38-495d-886c-c0213c996227 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:24.842115 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-fd4612db-afcb-4328-ab41-de27b09b7342 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:24.861682 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-fd4612db-afcb-4328-ab41-de27b09b7342 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.623116 Jun 24 09:45:24.862724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 219/421] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:24 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:24.963900 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-463b3b38-f8d0-4e29-9b5a-c3eaaa0bfdf3 req-5ad6c4a3-8e16-4c95-bfd7-40513eb72fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9395b1a-996b-49cf-93c7-44f262a92968", "tag": "a1b8e69a-e08f-4ca9-bfeb-3053eac1f832"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:24.981772 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-463b3b38-f8d0-4e29-9b5a-c3eaaa0bfdf3 req-5ad6c4a3-8e16-4c95-bfd7-40513eb72fa9 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:24.984898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-463b3b38-f8d0-4e29-9b5a-c3eaaa0bfdf3 req-5ad6c4a3-8e16-4c95-bfd7-40513eb72fa9 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:25.024869 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-463b3b38-f8d0-4e29-9b5a-c3eaaa0bfdf3 req-5ad6c4a3-8e16-4c95-bfd7-40513eb72fa9 service nova] Creating event network-changed:a1b8e69a-e08f-4ca9-bfeb-3053eac1f832 for instance a9395b1a-996b-49cf-93c7-44f262a92968 on hv-cinder-80382 Jun 24 09:45:25.030308 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-463b3b38-f8d0-4e29-9b5a-c3eaaa0bfdf3 req-5ad6c4a3-8e16-4c95-bfd7-40513eb72fa9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070745 Jun 24 09:45:25.031532 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 220/422] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:45:25.099545 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-8e8fa7b8-5e38-495d-886c-c0213c996227 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:25.117113 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-8e8fa7b8-5e38-495d-886c-c0213c996227 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:25.119571 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-8e8fa7b8-5e38-495d-886c-c0213c996227 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:25.121409 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-8e8fa7b8-5e38-495d-886c-c0213c996227 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.434757 Jun 24 09:45:25.130020 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 203/423] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:24 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:25.703439 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f5e7b29c-a3a5-4e8e-ab85-b088d43b74a8 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:25.704505 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-f5e7b29c-a3a5-4e8e-ab85-b088d43b74a8 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:25.718616 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f5e7b29c-a3a5-4e8e-ab85-b088d43b74a8 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:25.719942 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f5e7b29c-a3a5-4e8e-ab85-b088d43b74a8 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:25.720958 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f5e7b29c-a3a5-4e8e-ab85-b088d43b74a8 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:25.721582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f5e7b29c-a3a5-4e8e-ab85-b088d43b74a8 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:25.896377 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-01a4f089-7628-4dcc-bf27-e960773d585f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:25.897777 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-01a4f089-7628-4dcc-bf27-e960773d585f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:25.906721 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-01a4f089-7628-4dcc-bf27-e960773d585f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:25.907561 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-01a4f089-7628-4dcc-bf27-e960773d585f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:25.909350 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-01a4f089-7628-4dcc-bf27-e960773d585f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:25.910203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-01a4f089-7628-4dcc-bf27-e960773d585f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:25.937938 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-f5e7b29c-a3a5-4e8e-ab85-b088d43b74a8 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:25.941795 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=100 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:25.948123 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f5e7b29c-a3a5-4e8e-ab85-b088d43b74a8 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.250274 Jun 24 09:45:25.954305 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 221/424] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:25 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:26.078708 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-01a4f089-7628-4dcc-bf27-e960773d585f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:26.087233 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-01a4f089-7628-4dcc-bf27-e960773d585f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.197128 Jun 24 09:45:26.098199 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 204/425] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:25 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:26.153609 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4f613f96-f3f8-4036-808e-f7959089d759 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:26.154405 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-4f613f96-f3f8-4036-808e-f7959089d759 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:26.165983 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4f613f96-f3f8-4036-808e-f7959089d759 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:26.167830 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4f613f96-f3f8-4036-808e-f7959089d759 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:26.168729 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4f613f96-f3f8-4036-808e-f7959089d759 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:26.170885 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4f613f96-f3f8-4036-808e-f7959089d759 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:26.374290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4f613f96-f3f8-4036-808e-f7959089d759 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:26.397368 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4f613f96-f3f8-4036-808e-f7959089d759 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:26.399702 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4f613f96-f3f8-4036-808e-f7959089d759 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:26.402421 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-4f613f96-f3f8-4036-808e-f7959089d759 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.253151 Jun 24 09:45:26.407064 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 222/426] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:26 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:26.625995 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-7fc75cd7-47a6-4c64-9593-ec8db20ed6e1 req-de101472-8c1d-4b4c-96ea-8a63723d9b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d874254-475b-4025-8b67-b4af897fdb60", "name": "network-vif-plugged", "status": "completed", "tag": "de309464-eb94-4c38-b29b-c293a12d68b1"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:26.635857 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-7fc75cd7-47a6-4c64-9593-ec8db20ed6e1 req-de101472-8c1d-4b4c-96ea-8a63723d9b27 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:26.636473 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-7fc75cd7-47a6-4c64-9593-ec8db20ed6e1 req-de101472-8c1d-4b4c-96ea-8a63723d9b27 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:26.652394 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-7fc75cd7-47a6-4c64-9593-ec8db20ed6e1 req-de101472-8c1d-4b4c-96ea-8a63723d9b27 service nova] Creating event network-vif-plugged:de309464-eb94-4c38-b29b-c293a12d68b1 for instance 0d874254-475b-4025-8b67-b4af897fdb60 on hv-cinder-80382 Jun 24 09:45:26.658310 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-7fc75cd7-47a6-4c64-9593-ec8db20ed6e1 req-de101472-8c1d-4b4c-96ea-8a63723d9b27 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036200 Jun 24 09:45:26.659365 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 205/427] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:45:26.971571 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-30de5418-fa93-4eaf-a532-5f4418c3ecbd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:26.972317 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-30de5418-fa93-4eaf-a532-5f4418c3ecbd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:26.979539 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-30de5418-fa93-4eaf-a532-5f4418c3ecbd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:26.979995 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-30de5418-fa93-4eaf-a532-5f4418c3ecbd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:26.980788 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-30de5418-fa93-4eaf-a532-5f4418c3ecbd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:26.981226 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-30de5418-fa93-4eaf-a532-5f4418c3ecbd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:27.027613 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=2 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:27.106249 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-393c8b72-cfb0-49dd-a0d2-b79a3214c51c tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:27.106949 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-393c8b72-cfb0-49dd-a0d2-b79a3214c51c tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:27.108955 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=4 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:27.109630 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=14 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:27.116318 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-393c8b72-cfb0-49dd-a0d2-b79a3214c51c tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:27.116768 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-393c8b72-cfb0-49dd-a0d2-b79a3214c51c tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:27.117538 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-393c8b72-cfb0-49dd-a0d2-b79a3214c51c tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:27.117972 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-393c8b72-cfb0-49dd-a0d2-b79a3214c51c tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:27.118762 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-30de5418-fa93-4eaf-a532-5f4418c3ecbd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:27.126499 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-30de5418-fa93-4eaf-a532-5f4418c3ecbd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.159217 Jun 24 09:45:27.127083 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 223/428] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:26 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:27.275217 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-393c8b72-cfb0-49dd-a0d2-b79a3214c51c tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:27.282683 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-393c8b72-cfb0-49dd-a0d2-b79a3214c51c tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.180675 Jun 24 09:45:27.283270 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 206/429] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:27 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:27.422038 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a1a83279-acb0-42b3-93b4-b66449182840 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:27.423029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-a1a83279-acb0-42b3-93b4-b66449182840 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:27.437500 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a1a83279-acb0-42b3-93b4-b66449182840 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:27.438334 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a1a83279-acb0-42b3-93b4-b66449182840 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:27.439613 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a1a83279-acb0-42b3-93b4-b66449182840 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:27.440494 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a1a83279-acb0-42b3-93b4-b66449182840 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:27.603892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-a1a83279-acb0-42b3-93b4-b66449182840 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:27.616090 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-a1a83279-acb0-42b3-93b4-b66449182840 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:27.617868 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-a1a83279-acb0-42b3-93b4-b66449182840 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:27.620214 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-a1a83279-acb0-42b3-93b4-b66449182840 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.202260 Jun 24 09:45:27.633116 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 224/430] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:27 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:28.143818 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-05dd5990-5789-4da0-9294-cb358b6072bc tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:28.145096 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-05dd5990-5789-4da0-9294-cb358b6072bc tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:28.151826 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-05dd5990-5789-4da0-9294-cb358b6072bc tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:28.152264 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-05dd5990-5789-4da0-9294-cb358b6072bc tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:28.153025 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-05dd5990-5789-4da0-9294-cb358b6072bc tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:28.153448 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-05dd5990-5789-4da0-9294-cb358b6072bc tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:28.299610 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-05dd5990-5789-4da0-9294-cb358b6072bc tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:28.300256 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-beab3d2e-7502-40b3-ae24-41928c99881f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:28.300898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-beab3d2e-7502-40b3-ae24-41928c99881f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:28.307556 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-beab3d2e-7502-40b3-ae24-41928c99881f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:28.308005 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-beab3d2e-7502-40b3-ae24-41928c99881f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:28.308115 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-05dd5990-5789-4da0-9294-cb358b6072bc tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.168284 Jun 24 09:45:28.308791 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-beab3d2e-7502-40b3-ae24-41928c99881f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:28.309218 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-beab3d2e-7502-40b3-ae24-41928c99881f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:28.316849 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 207/431] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:28 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:28.463139 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-beab3d2e-7502-40b3-ae24-41928c99881f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:28.470568 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-beab3d2e-7502-40b3-ae24-41928c99881f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.174981 Jun 24 09:45:28.471205 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 225/432] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:28 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:28.639962 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-62526f27-5d56-4844-bf95-8af668d28a98 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:28.640591 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-62526f27-5d56-4844-bf95-8af668d28a98 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:28.647179 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-62526f27-5d56-4844-bf95-8af668d28a98 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:28.647549 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-62526f27-5d56-4844-bf95-8af668d28a98 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:28.648321 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-62526f27-5d56-4844-bf95-8af668d28a98 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:28.648742 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-62526f27-5d56-4844-bf95-8af668d28a98 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:28.794184 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-62526f27-5d56-4844-bf95-8af668d28a98 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:28.803024 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-62526f27-5d56-4844-bf95-8af668d28a98 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:28.804586 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-62526f27-5d56-4844-bf95-8af668d28a98 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:28.807588 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-62526f27-5d56-4844-bf95-8af668d28a98 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.171688 Jun 24 09:45:28.808144 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 208/433] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:28 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:29.326033 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1bbf5bf4-cdfb-4426-a0c1-1605a195ea4f tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:29.327356 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-1bbf5bf4-cdfb-4426-a0c1-1605a195ea4f tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:29.336835 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1bbf5bf4-cdfb-4426-a0c1-1605a195ea4f tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:29.337532 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1bbf5bf4-cdfb-4426-a0c1-1605a195ea4f tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:29.338711 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1bbf5bf4-cdfb-4426-a0c1-1605a195ea4f tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:29.339559 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1bbf5bf4-cdfb-4426-a0c1-1605a195ea4f tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:29.487806 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-658216ab-3315-4cec-8b6c-33bb2184a0e9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:29.489207 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-658216ab-3315-4cec-8b6c-33bb2184a0e9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:29.496315 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-658216ab-3315-4cec-8b6c-33bb2184a0e9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:29.496760 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-658216ab-3315-4cec-8b6c-33bb2184a0e9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:29.497535 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-658216ab-3315-4cec-8b6c-33bb2184a0e9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:29.497964 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-658216ab-3315-4cec-8b6c-33bb2184a0e9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:29.540246 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-1bbf5bf4-cdfb-4426-a0c1-1605a195ea4f tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:29.554071 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-1bbf5bf4-cdfb-4426-a0c1-1605a195ea4f tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.232419 Jun 24 09:45:29.554947 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 226/434] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:29 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:29.737004 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-658216ab-3315-4cec-8b6c-33bb2184a0e9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:29.747056 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-658216ab-3315-4cec-8b6c-33bb2184a0e9 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.262036 Jun 24 09:45:29.756961 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 209/435] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:29 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:45:29.834783 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-fbdc6edb-0b9f-4b11-999b-10c83993c6e4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:29.844217 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-fbdc6edb-0b9f-4b11-999b-10c83993c6e4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:29.852586 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fbdc6edb-0b9f-4b11-999b-10c83993c6e4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:29.853340 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fbdc6edb-0b9f-4b11-999b-10c83993c6e4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:29.854116 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fbdc6edb-0b9f-4b11-999b-10c83993c6e4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:29.854685 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fbdc6edb-0b9f-4b11-999b-10c83993c6e4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:30.001841 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-fbdc6edb-0b9f-4b11-999b-10c83993c6e4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:30.010639 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-fbdc6edb-0b9f-4b11-999b-10c83993c6e4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:30.012320 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-fbdc6edb-0b9f-4b11-999b-10c83993c6e4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:30.013495 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-fbdc6edb-0b9f-4b11-999b-10c83993c6e4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.191170 Jun 24 09:45:30.014060 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 227/436] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:29 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:30.573281 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-5e0176dc-5570-4b0a-8c1b-a7a78449b2f7 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:30.574013 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-5e0176dc-5570-4b0a-8c1b-a7a78449b2f7 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:30.581248 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5e0176dc-5570-4b0a-8c1b-a7a78449b2f7 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:30.581842 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5e0176dc-5570-4b0a-8c1b-a7a78449b2f7 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:30.583807 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5e0176dc-5570-4b0a-8c1b-a7a78449b2f7 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:30.584298 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5e0176dc-5570-4b0a-8c1b-a7a78449b2f7 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:30.743307 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-5e0176dc-5570-4b0a-8c1b-a7a78449b2f7 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:30.759511 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-5e0176dc-5570-4b0a-8c1b-a7a78449b2f7 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.184378 Jun 24 09:45:30.766611 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a0220893-590b-4b30-af5a-6da408afbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:30.767762 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-a0220893-590b-4b30-af5a-6da408afbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:30.771184 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 210/437] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:30 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:30.784673 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a0220893-590b-4b30-af5a-6da408afbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:30.785163 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a0220893-590b-4b30-af5a-6da408afbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:30.786081 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a0220893-590b-4b30-af5a-6da408afbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:30.786747 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a0220893-590b-4b30-af5a-6da408afbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:30.963189 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-a0220893-590b-4b30-af5a-6da408afbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:30.971971 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-a0220893-590b-4b30-af5a-6da408afbeb1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.210956 Jun 24 09:45:30.972763 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 228/438] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:30 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:45:31.033953 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-5b914afb-bb21-4e9d-a619-b68cb64df9f5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:31.034505 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-5b914afb-bb21-4e9d-a619-b68cb64df9f5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:31.042615 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5b914afb-bb21-4e9d-a619-b68cb64df9f5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:31.043471 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5b914afb-bb21-4e9d-a619-b68cb64df9f5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:31.045037 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5b914afb-bb21-4e9d-a619-b68cb64df9f5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:31.045915 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5b914afb-bb21-4e9d-a619-b68cb64df9f5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:31.254897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-5b914afb-bb21-4e9d-a619-b68cb64df9f5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:31.264428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-5b914afb-bb21-4e9d-a619-b68cb64df9f5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:31.265967 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-5b914afb-bb21-4e9d-a619-b68cb64df9f5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:31.267390 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-5b914afb-bb21-4e9d-a619-b68cb64df9f5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.239460 Jun 24 09:45:31.268273 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 211/439] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:31 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:31.787205 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7b84f1c2-7071-49ff-b270-a79d222c18e3 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:31.788079 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-7b84f1c2-7071-49ff-b270-a79d222c18e3 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:31.795530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7b84f1c2-7071-49ff-b270-a79d222c18e3 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:31.796169 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7b84f1c2-7071-49ff-b270-a79d222c18e3 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:31.797036 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7b84f1c2-7071-49ff-b270-a79d222c18e3 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:31.797636 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7b84f1c2-7071-49ff-b270-a79d222c18e3 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:31.984569 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-7b84f1c2-7071-49ff-b270-a79d222c18e3 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:31.991721 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-8dc87026-3951-4d5b-8217-0e8413d1c581 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:31.992415 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-8dc87026-3951-4d5b-8217-0e8413d1c581 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:31.995150 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-7b84f1c2-7071-49ff-b270-a79d222c18e3 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.211998 Jun 24 09:45:31.996282 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 229/440] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:31 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:32.008744 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8dc87026-3951-4d5b-8217-0e8413d1c581 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:32.009210 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8dc87026-3951-4d5b-8217-0e8413d1c581 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:32.009963 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8dc87026-3951-4d5b-8217-0e8413d1c581 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:32.010567 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8dc87026-3951-4d5b-8217-0e8413d1c581 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:32.162973 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-8dc87026-3951-4d5b-8217-0e8413d1c581 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:32.172149 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-8dc87026-3951-4d5b-8217-0e8413d1c581 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.186090 Jun 24 09:45:32.172730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 212/441] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:31 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:32.288111 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-8535059a-43c2-4abf-a618-d15e2cee3d2e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:32.288741 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-8535059a-43c2-4abf-a618-d15e2cee3d2e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:32.295766 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8535059a-43c2-4abf-a618-d15e2cee3d2e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:32.296224 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8535059a-43c2-4abf-a618-d15e2cee3d2e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:32.297023 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8535059a-43c2-4abf-a618-d15e2cee3d2e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:32.297458 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8535059a-43c2-4abf-a618-d15e2cee3d2e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:32.442848 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-8535059a-43c2-4abf-a618-d15e2cee3d2e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:32.451922 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-8535059a-43c2-4abf-a618-d15e2cee3d2e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:32.453437 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-8535059a-43c2-4abf-a618-d15e2cee3d2e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:32.454605 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-8535059a-43c2-4abf-a618-d15e2cee3d2e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.170554 Jun 24 09:45:32.455236 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 230/442] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:32 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:32.977876 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-830ef002-a8dc-4056-aa2b-c9ab7215dd2b tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-598798722", "imageRef": "844ad823-18a2-4abc-813c-2d1825141591", "flavorRef": "452"}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:33.012826 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-5fe2b4e3-a4b6-4c66-88b6-9343b67a2d2c tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:33.013364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-5fe2b4e3-a4b6-4c66-88b6-9343b67a2d2c tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:33.020557 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5fe2b4e3-a4b6-4c66-88b6-9343b67a2d2c tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:33.021084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5fe2b4e3-a4b6-4c66-88b6-9343b67a2d2c tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:33.022843 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5fe2b4e3-a4b6-4c66-88b6-9343b67a2d2c tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:33.023372 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5fe2b4e3-a4b6-4c66-88b6-9343b67a2d2c tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:33.032321 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.network.neutron [None req-830ef002-a8dc-4056-aa2b-c9ab7215dd2b tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] validate_networks() for None {{(pid=124338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:45:33.313327 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-5fe2b4e3-a4b6-4c66-88b6-9343b67a2d2c tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:33.322166 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-5fe2b4e3-a4b6-4c66-88b6-9343b67a2d2c tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.313292 Jun 24 09:45:33.322749 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 231/443] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:33 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:33.327426 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-d9b7b20d-23e8-45a8-8ca0-c82139898db3 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:33.328027 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-d9b7b20d-23e8-45a8-8ca0-c82139898db3 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:33.334618 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d9b7b20d-23e8-45a8-8ca0-c82139898db3 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:33.335223 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d9b7b20d-23e8-45a8-8ca0-c82139898db3 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:33.336000 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d9b7b20d-23e8-45a8-8ca0-c82139898db3 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:33.336470 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d9b7b20d-23e8-45a8-8ca0-c82139898db3 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:33.375215 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-830ef002-a8dc-4056-aa2b-c9ab7215dd2b tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Flavor limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:45:33.375636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-830ef002-a8dc-4056-aa2b-c9ab7215dd2b tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Image limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:45:33.376102 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-830ef002-a8dc-4056-aa2b-c9ab7215dd2b tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Flavor pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:45:33.376502 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-830ef002-a8dc-4056-aa2b-c9ab7215dd2b tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Image pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:45:33.376909 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-830ef002-a8dc-4056-aa2b-c9ab7215dd2b tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:45:33.387134 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-830ef002-a8dc-4056-aa2b-c9ab7215dd2b tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:33.387602 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-830ef002-a8dc-4056-aa2b-c9ab7215dd2b tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:33.388390 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-830ef002-a8dc-4056-aa2b-c9ab7215dd2b tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:33.388817 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-830ef002-a8dc-4056-aa2b-c9ab7215dd2b tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:33.406497 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-830ef002-a8dc-4056-aa2b-c9ab7215dd2b tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Getting quotas for project c15e1bb5bd1741ae98304f809dea24f7. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:45:33.407839 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:33.412937 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-830ef002-a8dc-4056-aa2b-c9ab7215dd2b tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Getting quotas for user a3283218fb79487491de597fdfc16916 and project c15e1bb5bd1741ae98304f809dea24f7. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:45:33.424725 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-830ef002-a8dc-4056-aa2b-c9ab7215dd2b tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Going to run 1 instances... {{(pid=124338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:45:33.426971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-830ef002-a8dc-4056-aa2b-c9ab7215dd2b tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='844ad823-18a2-4abc-813c-2d1825141591',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:45:33.476589 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-830ef002-a8dc-4056-aa2b-c9ab7215dd2b tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503454 Jun 24 09:45:33.477480 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 213/444] 10.222.0.65 () {60 vars in 1146 bytes} [Fri Jun 24 09:45:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 09:45:33.481424 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-d9b7b20d-23e8-45a8-8ca0-c82139898db3 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:33.481959 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-38c4d4e2-6898-4042-879d-e9a28e6cf7bd tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:33.482547 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-38c4d4e2-6898-4042-879d-e9a28e6cf7bd tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:33.489341 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-38c4d4e2-6898-4042-879d-e9a28e6cf7bd tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:33.489793 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-38c4d4e2-6898-4042-879d-e9a28e6cf7bd tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:33.490773 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-38c4d4e2-6898-4042-879d-e9a28e6cf7bd tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:33.491242 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-38c4d4e2-6898-4042-879d-e9a28e6cf7bd tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:33.493608 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-d9b7b20d-23e8-45a8-8ca0-c82139898db3 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.169823 Jun 24 09:45:33.494696 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 232/445] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:33 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:33.499756 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f882ae5a-780a-43d2-aaba-dab7a9ffb307 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:33.500373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-f882ae5a-780a-43d2-aaba-dab7a9ffb307 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:33.576030 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-f882ae5a-780a-43d2-aaba-dab7a9ffb307 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3283218fb79487491de597fdfc16916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e1bb5bd1741ae98304f809dea24f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:33.583345 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f882ae5a-780a-43d2-aaba-dab7a9ffb307 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 200 len: 1214 microversion: 2.1 time: 0.087255 Jun 24 09:45:33.584288 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 233/446] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:33 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:33.650954 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-38c4d4e2-6898-4042-879d-e9a28e6cf7bd tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:33.659829 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-38c4d4e2-6898-4042-879d-e9a28e6cf7bd tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:33.661432 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-38c4d4e2-6898-4042-879d-e9a28e6cf7bd tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:33.662721 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-38c4d4e2-6898-4042-879d-e9a28e6cf7bd tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.184330 Jun 24 09:45:33.663233 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 214/447] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:33 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:34.343469 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-61e1612f-5032-497a-88da-8e5a53280566 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:34.344647 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-61e1612f-5032-497a-88da-8e5a53280566 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:34.356243 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-61e1612f-5032-497a-88da-8e5a53280566 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:34.356977 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-61e1612f-5032-497a-88da-8e5a53280566 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:34.358226 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-61e1612f-5032-497a-88da-8e5a53280566 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:34.358939 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-61e1612f-5032-497a-88da-8e5a53280566 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:34.503960 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-61e1612f-5032-497a-88da-8e5a53280566 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:34.513397 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-468f7315-f2a4-4ff9-803d-c787a9d205ff tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:34.514034 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-468f7315-f2a4-4ff9-803d-c787a9d205ff tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:34.515132 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-61e1612f-5032-497a-88da-8e5a53280566 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.177887 Jun 24 09:45:34.515708 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 234/448] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:34 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:45:34.521594 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-468f7315-f2a4-4ff9-803d-c787a9d205ff tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:34.522046 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-468f7315-f2a4-4ff9-803d-c787a9d205ff tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:34.522835 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-468f7315-f2a4-4ff9-803d-c787a9d205ff tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:34.523313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-468f7315-f2a4-4ff9-803d-c787a9d205ff tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:34.601778 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-2d013515-1d41-46ef-8ae4-6bdcfd6d7541 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:34.602282 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-2d013515-1d41-46ef-8ae4-6bdcfd6d7541 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:34.608583 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2d013515-1d41-46ef-8ae4-6bdcfd6d7541 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:34.609027 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2d013515-1d41-46ef-8ae4-6bdcfd6d7541 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:34.609796 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2d013515-1d41-46ef-8ae4-6bdcfd6d7541 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:34.610222 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2d013515-1d41-46ef-8ae4-6bdcfd6d7541 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:34.686289 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-2d013515-1d41-46ef-8ae4-6bdcfd6d7541 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3283218fb79487491de597fdfc16916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e1bb5bd1741ae98304f809dea24f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:34.694757 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-2d013515-1d41-46ef-8ae4-6bdcfd6d7541 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 200 len: 1218 microversion: 2.1 time: 0.097328 Jun 24 09:45:34.695213 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 235/449] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:34 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:34.699995 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b8581b5e-373f-41eb-aca3-bd5b61b43d38 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:34.700576 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-b8581b5e-373f-41eb-aca3-bd5b61b43d38 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:34.701151 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-468f7315-f2a4-4ff9-803d-c787a9d205ff tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:34.706723 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b8581b5e-373f-41eb-aca3-bd5b61b43d38 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:34.707213 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b8581b5e-373f-41eb-aca3-bd5b61b43d38 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:34.707985 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b8581b5e-373f-41eb-aca3-bd5b61b43d38 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:34.708420 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b8581b5e-373f-41eb-aca3-bd5b61b43d38 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:34.708775 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-468f7315-f2a4-4ff9-803d-c787a9d205ff tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.201289 Jun 24 09:45:34.709760 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 215/450] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:34 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:34.838106 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b8581b5e-373f-41eb-aca3-bd5b61b43d38 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:34.846899 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b8581b5e-373f-41eb-aca3-bd5b61b43d38 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:34.848453 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b8581b5e-373f-41eb-aca3-bd5b61b43d38 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:34.850068 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b8581b5e-373f-41eb-aca3-bd5b61b43d38 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.153684 Jun 24 09:45:34.850984 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 236/451] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:34 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:35.536477 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-17a64160-7638-445e-9b3c-2053d991242d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:35.537480 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-17a64160-7638-445e-9b3c-2053d991242d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:35.544617 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-17a64160-7638-445e-9b3c-2053d991242d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:35.545064 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-17a64160-7638-445e-9b3c-2053d991242d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:35.545832 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-17a64160-7638-445e-9b3c-2053d991242d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:35.546272 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-17a64160-7638-445e-9b3c-2053d991242d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:35.567480 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:35.690945 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-17a64160-7638-445e-9b3c-2053d991242d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:35.700128 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-17a64160-7638-445e-9b3c-2053d991242d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.170299 Jun 24 09:45:35.700717 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 216/452] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:35 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:35.713595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4691b89f-8a63-4b45-8438-52a8ef94dafc tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:35.714521 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-4691b89f-8a63-4b45-8438-52a8ef94dafc tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:35.724372 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4691b89f-8a63-4b45-8438-52a8ef94dafc tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:35.725088 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4691b89f-8a63-4b45-8438-52a8ef94dafc tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:35.726727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4691b89f-8a63-4b45-8438-52a8ef94dafc tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:35.727181 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4691b89f-8a63-4b45-8438-52a8ef94dafc tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:35.727627 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-596b9c98-1f69-4c90-942f-daec0fe61f37 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:35.728240 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-596b9c98-1f69-4c90-942f-daec0fe61f37 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:35.734391 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-596b9c98-1f69-4c90-942f-daec0fe61f37 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:35.734872 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-596b9c98-1f69-4c90-942f-daec0fe61f37 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:35.735666 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-596b9c98-1f69-4c90-942f-daec0fe61f37 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:35.736098 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-596b9c98-1f69-4c90-942f-daec0fe61f37 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:35.800799 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4691b89f-8a63-4b45-8438-52a8ef94dafc tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3283218fb79487491de597fdfc16916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e1bb5bd1741ae98304f809dea24f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:35.809099 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-4691b89f-8a63-4b45-8438-52a8ef94dafc tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 200 len: 1218 microversion: 2.1 time: 0.101279 Jun 24 09:45:35.809761 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 237/453] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:35 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:35.872825 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-2cda1a1b-89c6-493a-a788-37995ddcf952 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:35.873571 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-2cda1a1b-89c6-493a-a788-37995ddcf952 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:35.879999 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2cda1a1b-89c6-493a-a788-37995ddcf952 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:35.880461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2cda1a1b-89c6-493a-a788-37995ddcf952 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:35.881349 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2cda1a1b-89c6-493a-a788-37995ddcf952 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:35.881861 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2cda1a1b-89c6-493a-a788-37995ddcf952 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:35.890485 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-596b9c98-1f69-4c90-942f-daec0fe61f37 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:35.898963 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-596b9c98-1f69-4c90-942f-daec0fe61f37 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.176476 Jun 24 09:45:35.899564 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 217/454] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:35 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:36.017120 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-2cda1a1b-89c6-493a-a788-37995ddcf952 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:36.027906 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-2cda1a1b-89c6-493a-a788-37995ddcf952 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:36.029407 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-2cda1a1b-89c6-493a-a788-37995ddcf952 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:36.030568 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-2cda1a1b-89c6-493a-a788-37995ddcf952 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.161832 Jun 24 09:45:36.031141 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 238/455] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:35 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:45:36.720615 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-f92a4b5f-2d6d-41a1-93a9-9fac827a6155 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:36.721537 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-f92a4b5f-2d6d-41a1-93a9-9fac827a6155 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:36.732296 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f92a4b5f-2d6d-41a1-93a9-9fac827a6155 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:36.732986 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f92a4b5f-2d6d-41a1-93a9-9fac827a6155 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:36.734143 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f92a4b5f-2d6d-41a1-93a9-9fac827a6155 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:36.734798 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f92a4b5f-2d6d-41a1-93a9-9fac827a6155 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:36.812626 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f734939c-6d24-474b-9d71-054995d6d971 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:36.813223 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-f734939c-6d24-474b-9d71-054995d6d971 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:36.820312 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f734939c-6d24-474b-9d71-054995d6d971 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:36.820986 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f734939c-6d24-474b-9d71-054995d6d971 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:36.821944 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f734939c-6d24-474b-9d71-054995d6d971 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:36.822376 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f734939c-6d24-474b-9d71-054995d6d971 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:36.840573 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=100 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:36.856990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f734939c-6d24-474b-9d71-054995d6d971 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789/ips" status: 200 len: 148 microversion: 2.1 time: 0.040244 Jun 24 09:45:36.856990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 239/456] 10.222.0.65 () {58 vars in 1247 bytes} [Fri Jun 24 09:45:36 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:45:36.856990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-059861c9-ac23-4356-9d1f-52bb448f7ae4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:36.856990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-059861c9-ac23-4356-9d1f-52bb448f7ae4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:36.857454 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:36.862751 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-059861c9-ac23-4356-9d1f-52bb448f7ae4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:36.863232 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-059861c9-ac23-4356-9d1f-52bb448f7ae4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:36.864010 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-059861c9-ac23-4356-9d1f-52bb448f7ae4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:36.864450 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-059861c9-ac23-4356-9d1f-52bb448f7ae4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:36.887294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f92a4b5f-2d6d-41a1-93a9-9fac827a6155 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:36.895873 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-f92a4b5f-2d6d-41a1-93a9-9fac827a6155 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.181203 Jun 24 09:45:36.896571 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 218/457] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:36 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:36.902331 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-cfef0cbf-44a1-436b-95bf-9111f1005430 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "519d9c43-fb95-426e-bbe1-6d82343cc12d"}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:36.903613 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-cfef0cbf-44a1-436b-95bf-9111f1005430 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:36.910382 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-cfef0cbf-44a1-436b-95bf-9111f1005430 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:36.911175 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-cfef0cbf-44a1-436b-95bf-9111f1005430 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:36.911971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-cfef0cbf-44a1-436b-95bf-9111f1005430 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:36.912396 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-cfef0cbf-44a1-436b-95bf-9111f1005430 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:36.928729 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-059861c9-ac23-4356-9d1f-52bb448f7ae4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3283218fb79487491de597fdfc16916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e1bb5bd1741ae98304f809dea24f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:36.936743 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-059861c9-ac23-4356-9d1f-52bb448f7ae4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 200 len: 1218 microversion: 2.1 time: 0.086228 Jun 24 09:45:36.937323 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 240/458] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:36 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:36.942211 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f55b5a22-2735-4ac4-b73f-27b8fa3e77b2 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:36.943219 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-f55b5a22-2735-4ac4-b73f-27b8fa3e77b2 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:36.949059 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f55b5a22-2735-4ac4-b73f-27b8fa3e77b2 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:36.949545 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f55b5a22-2735-4ac4-b73f-27b8fa3e77b2 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:36.950315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f55b5a22-2735-4ac4-b73f-27b8fa3e77b2 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:36.950774 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f55b5a22-2735-4ac4-b73f-27b8fa3e77b2 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:36.993275 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.wsgi [None req-cfef0cbf-44a1-436b-95bf-9111f1005430 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] HTTP exception thrown: Invalid volume: volume 519d9c43-fb95-426e-bbe1-6d82343cc12d is already attached to instances: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef Jun 24 09:45:36.995636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-cfef0cbf-44a1-436b-95bf-9111f1005430 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Request method failure captured: Jun 24 09:45:36.995636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: POST /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789/os-volume_attachments HTTP/1.1 Jun 24 09:45:36.995636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:45:36.995636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:45:36.995636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:45:36.995636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 74 Jun 24 09:45:36.995636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:45:36.995636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:45:36.995636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:45:36.995636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:45:36.995636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYbvJ3i86IfpBOV1GhbK6BjjMPGc6Tm1uaFsF_cm2jflXXzg3yQgcdVgGx8TFBVweDptNaGL-vvoreBeBGl_GS39sHCNfkE3V7sePQxiYoI7e3NRcV5C6bE6H-sdZ6Daa5bOcdZzQqk3HMpLiyCtZEkhPHZ6MJeA9vI9pz9NKdB8VSk Jun 24 09:45:36.995636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:45:36.995636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:45:36.995636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:45:36.995636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:45:36.995636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:45:36.995636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:45:36.995636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:45:36.995636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:45:36.995636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:45:36.995636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:45:36.997252 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_30033ce42b5a43b78dde38163831cea2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:45:36.997252 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:45:36.997252 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:45:36.997252 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:45:36.997252 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:45:36.997252 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:45:36.997252 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:45:36.997252 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: fd136fcda9a04a16b258301a86bde8ef Jun 24 09:45:36.997252 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:45:36.997252 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Jun 24 09:45:36.997252 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {"volumeAttachment": {"volumeId": "519d9c43-fb95-426e-bbe1-6d82343cc12d"}} Jun 24 09:45:36.997252 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: > Jun 24 09:45:36.998158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Invalid volume: volume 519d9c43-fb95-426e-bbe1-6d82343cc12d is already attached to instances: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef Jun 24 09:45:36.998158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'server_id': '67719189-e3da-4e2f-99cd-a136ece74789', 'body': {'volumeAttachment': {'volumeId': '519d9c43-fb95-426e-bbe1-6d82343cc12d'}}} Jun 24 09:45:36.998158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:45:36.998158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:45:36.998158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 09:45:36.998158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 09:45:36.998158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 09:45:36.998158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:45:36.998158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 09:45:36.998158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 09:45:36.998158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 24 09:45:36.998158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 24 09:45:36.998158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 24 09:45:36.998158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 24 09:45:36.998158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 519d9c43-fb95-426e-bbe1-6d82343cc12d is already attached to instances: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef Jun 24 09:45:36.998158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:45:36.998158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:45:36.998158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:45:36.998158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:45:36.999690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:45:36.999690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:45:36.999690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:45:36.999690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:45:36.999690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:45:36.999690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:45:36.999690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 09:45:36.999690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 09:45:36.999690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 09:45:36.999690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 09:45:36.999690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 09:45:36.999690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 09:45:36.999690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 24 09:45:36.999690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 09:45:36.999690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 519d9c43-fb95-426e-bbe1-6d82343cc12d is already attached to instances: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef Jun 24 09:45:36.999690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:45:36.999690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:45:36.999690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:45:36.999690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:45:36.999690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:45:37.001250 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:45:37.001250 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:45:37.001250 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:45:37.001250 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 519d9c43-fb95-426e-bbe1-6d82343cc12d is already attached to instances: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef Jun 24 09:45:37.001250 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:45:37.001250 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-cfef0cbf-44a1-436b-95bf-9111f1005430 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Returning 400 to user: Invalid volume: volume 519d9c43-fb95-426e-bbe1-6d82343cc12d is already attached to instances: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:45:37.001250 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-cfef0cbf-44a1-436b-95bf-9111f1005430 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "POST /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099493 Jun 24 09:45:37.001250 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 219/459] 10.222.0.65 () {60 vars in 1322 bytes} [Fri Jun 24 09:45:36 2022] POST /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 09:45:37.005812 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-e8f71cc9-cff5-4782-bed2-45216c89c7a7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:37.006421 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-e8f71cc9-cff5-4782-bed2-45216c89c7a7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:37.012766 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e8f71cc9-cff5-4782-bed2-45216c89c7a7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:37.013213 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e8f71cc9-cff5-4782-bed2-45216c89c7a7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:37.013980 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e8f71cc9-cff5-4782-bed2-45216c89c7a7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:37.015015 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e8f71cc9-cff5-4782-bed2-45216c89c7a7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:37.040842 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-e8f71cc9-cff5-4782-bed2-45216c89c7a7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Going to try to terminate instance {{(pid=124338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:45:37.085532 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-f55b5a22-2735-4ac4-b73f-27b8fa3e77b2 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:37.093488 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f55b5a22-2735-4ac4-b73f-27b8fa3e77b2 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.155037 Jun 24 09:45:37.093999 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 241/460] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:36 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:37.099525 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-ccaaeaa8-c841-450e-bb18-9f42df3a3078 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:37.100716 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-ccaaeaa8-c841-450e-bb18-9f42df3a3078 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:37.107825 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ccaaeaa8-c841-450e-bb18-9f42df3a3078 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:37.108274 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ccaaeaa8-c841-450e-bb18-9f42df3a3078 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:37.109046 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ccaaeaa8-c841-450e-bb18-9f42df3a3078 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:37.109485 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ccaaeaa8-c841-450e-bb18-9f42df3a3078 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:37.123533 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-e8f71cc9-cff5-4782-bed2-45216c89c7a7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "DELETE /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 204 len: 0 microversion: 2.1 time: 0.121078 Jun 24 09:45:37.124122 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 220/461] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:45:37 2022] DELETE /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:45:37.133308 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-eb335a7b-7c69-4f98-b6f8-24b20c721742 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:37.134012 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-eb335a7b-7c69-4f98-b6f8-24b20c721742 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:37.140041 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-eb335a7b-7c69-4f98-b6f8-24b20c721742 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:37.140488 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-eb335a7b-7c69-4f98-b6f8-24b20c721742 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:37.141246 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-eb335a7b-7c69-4f98-b6f8-24b20c721742 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:37.141673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-eb335a7b-7c69-4f98-b6f8-24b20c721742 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:37.297594 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ccaaeaa8-c841-450e-bb18-9f42df3a3078 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:37.306511 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ccaaeaa8-c841-450e-bb18-9f42df3a3078 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:37.308068 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ccaaeaa8-c841-450e-bb18-9f42df3a3078 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:37.309214 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-ccaaeaa8-c841-450e-bb18-9f42df3a3078 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.214196 Jun 24 09:45:37.309770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 242/462] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:37 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:37.319531 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-eb335a7b-7c69-4f98-b6f8-24b20c721742 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:37.327509 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-eb335a7b-7c69-4f98-b6f8-24b20c721742 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1680 microversion: 2.1 time: 0.198882 Jun 24 09:45:37.328090 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 221/463] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:37 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:37.912607 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-97e6e738-ca2f-4a66-bc7d-c23436181de2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:37.913178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-97e6e738-ca2f-4a66-bc7d-c23436181de2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:37.920893 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-97e6e738-ca2f-4a66-bc7d-c23436181de2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:37.921340 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-97e6e738-ca2f-4a66-bc7d-c23436181de2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:37.922097 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-97e6e738-ca2f-4a66-bc7d-c23436181de2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:37.922522 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-97e6e738-ca2f-4a66-bc7d-c23436181de2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:37.953859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-e80bb512-5d34-4df4-b40c-c68293c69154 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:37.954540 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-e80bb512-5d34-4df4-b40c-c68293c69154 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:37.965169 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e80bb512-5d34-4df4-b40c-c68293c69154 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:37.965667 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e80bb512-5d34-4df4-b40c-c68293c69154 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:37.966731 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e80bb512-5d34-4df4-b40c-c68293c69154 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:37.967272 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e80bb512-5d34-4df4-b40c-c68293c69154 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:38.044740 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-e80bb512-5d34-4df4-b40c-c68293c69154 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3283218fb79487491de597fdfc16916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e1bb5bd1741ae98304f809dea24f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:38.052648 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-e80bb512-5d34-4df4-b40c-c68293c69154 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 200 len: 1218 microversion: 2.1 time: 0.102672 Jun 24 09:45:38.053222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 222/464] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:37 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:38.082454 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-97e6e738-ca2f-4a66-bc7d-c23436181de2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:38.091167 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-97e6e738-ca2f-4a66-bc7d-c23436181de2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.182431 Jun 24 09:45:38.091735 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 243/465] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:37 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:38.109751 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-5fd20ce6-e6ed-4dc6-b4b7-2e3de5ea546f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:38.110360 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-5fd20ce6-e6ed-4dc6-b4b7-2e3de5ea546f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:38.116921 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5fd20ce6-e6ed-4dc6-b4b7-2e3de5ea546f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:38.117548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5fd20ce6-e6ed-4dc6-b4b7-2e3de5ea546f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:38.118333 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5fd20ce6-e6ed-4dc6-b4b7-2e3de5ea546f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:38.118766 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5fd20ce6-e6ed-4dc6-b4b7-2e3de5ea546f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:38.264450 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-5fd20ce6-e6ed-4dc6-b4b7-2e3de5ea546f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:38.272387 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-5fd20ce6-e6ed-4dc6-b4b7-2e3de5ea546f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.166412 Jun 24 09:45:38.274348 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 223/466] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:38 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:38.329705 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1ece4021-3029-40e2-94c3-9deff2723222 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:38.330435 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-1ece4021-3029-40e2-94c3-9deff2723222 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:38.337454 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1ece4021-3029-40e2-94c3-9deff2723222 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:38.338004 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1ece4021-3029-40e2-94c3-9deff2723222 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:38.338919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1ece4021-3029-40e2-94c3-9deff2723222 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:38.339469 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1ece4021-3029-40e2-94c3-9deff2723222 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:38.348644 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-bb932ce1-09ca-4d2b-ba5b-d60fdd647762 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:38.349768 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-bb932ce1-09ca-4d2b-ba5b-d60fdd647762 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:38.359703 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-bb932ce1-09ca-4d2b-ba5b-d60fdd647762 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:38.360378 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-bb932ce1-09ca-4d2b-ba5b-d60fdd647762 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:38.361406 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-bb932ce1-09ca-4d2b-ba5b-d60fdd647762 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:38.362000 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-bb932ce1-09ca-4d2b-ba5b-d60fdd647762 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:38.549742 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-1ece4021-3029-40e2-94c3-9deff2723222 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:38.559055 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-1ece4021-3029-40e2-94c3-9deff2723222 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:38.560604 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-1ece4021-3029-40e2-94c3-9deff2723222 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:38.561809 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-1ece4021-3029-40e2-94c3-9deff2723222 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.236916 Jun 24 09:45:38.562508 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 244/467] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:38 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:45:38.577160 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-bb932ce1-09ca-4d2b-ba5b-d60fdd647762 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:38.586660 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-bb932ce1-09ca-4d2b-ba5b-d60fdd647762 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1680 microversion: 2.1 time: 0.245128 Jun 24 09:45:38.587304 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 224/468] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:38 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1680 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:45:39.070294 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-ce7ed432-4d30-45aa-9712-a463461f12cf tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:39.070944 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-ce7ed432-4d30-45aa-9712-a463461f12cf tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:39.078240 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ce7ed432-4d30-45aa-9712-a463461f12cf tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:39.078695 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ce7ed432-4d30-45aa-9712-a463461f12cf tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:39.079502 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ce7ed432-4d30-45aa-9712-a463461f12cf tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:39.079939 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ce7ed432-4d30-45aa-9712-a463461f12cf tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:39.107517 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-c719bf9c-61e7-4374-a7d5-9c009489f98e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:39.108137 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-c719bf9c-61e7-4374-a7d5-9c009489f98e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:39.115051 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c719bf9c-61e7-4374-a7d5-9c009489f98e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:39.115533 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c719bf9c-61e7-4374-a7d5-9c009489f98e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:39.116276 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c719bf9c-61e7-4374-a7d5-9c009489f98e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:39.116740 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c719bf9c-61e7-4374-a7d5-9c009489f98e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:39.145438 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ce7ed432-4d30-45aa-9712-a463461f12cf tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3283218fb79487491de597fdfc16916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e1bb5bd1741ae98304f809dea24f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:39.157005 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-ce7ed432-4d30-45aa-9712-a463461f12cf tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 200 len: 1210 microversion: 2.1 time: 0.090719 Jun 24 09:45:39.157582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 245/469] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:39 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:39.258227 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-c719bf9c-61e7-4374-a7d5-9c009489f98e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:39.266421 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-c719bf9c-61e7-4374-a7d5-9c009489f98e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.162719 Jun 24 09:45:39.266964 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 225/470] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:39 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:39.289961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-01130982-14b0-4ad5-b45a-6562038fd3f4 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:39.290576 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-01130982-14b0-4ad5-b45a-6562038fd3f4 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:39.296820 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-01130982-14b0-4ad5-b45a-6562038fd3f4 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:39.297266 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-01130982-14b0-4ad5-b45a-6562038fd3f4 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:39.298030 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-01130982-14b0-4ad5-b45a-6562038fd3f4 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:39.298462 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-01130982-14b0-4ad5-b45a-6562038fd3f4 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:39.437160 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-01130982-14b0-4ad5-b45a-6562038fd3f4 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:39.446796 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-01130982-14b0-4ad5-b45a-6562038fd3f4 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.160830 Jun 24 09:45:39.447415 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 246/471] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:39 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:39.582620 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-fcd26983-19f4-44c0-b597-a8c6db8e0e12 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:39.583174 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-fcd26983-19f4-44c0-b597-a8c6db8e0e12 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:39.590891 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fcd26983-19f4-44c0-b597-a8c6db8e0e12 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:39.591369 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fcd26983-19f4-44c0-b597-a8c6db8e0e12 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:39.592130 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fcd26983-19f4-44c0-b597-a8c6db8e0e12 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:39.592556 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fcd26983-19f4-44c0-b597-a8c6db8e0e12 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:39.609177 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e28c4cfd-3e0e-48e8-816d-714352a3d586 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:39.609824 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e28c4cfd-3e0e-48e8-816d-714352a3d586 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:39.616715 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e28c4cfd-3e0e-48e8-816d-714352a3d586 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:39.617265 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e28c4cfd-3e0e-48e8-816d-714352a3d586 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:39.618325 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e28c4cfd-3e0e-48e8-816d-714352a3d586 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:39.618742 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e28c4cfd-3e0e-48e8-816d-714352a3d586 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:39.815988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-fcd26983-19f4-44c0-b597-a8c6db8e0e12 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:39.823610 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e28c4cfd-3e0e-48e8-816d-714352a3d586 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:39.825342 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-fcd26983-19f4-44c0-b597-a8c6db8e0e12 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:39.826845 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-fcd26983-19f4-44c0-b597-a8c6db8e0e12 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:39.828107 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-fcd26983-19f4-44c0-b597-a8c6db8e0e12 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.250314 Jun 24 09:45:39.828668 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 226/472] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:39 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:39.831567 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e28c4cfd-3e0e-48e8-816d-714352a3d586 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1680 microversion: 2.1 time: 0.226297 Jun 24 09:45:39.832131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 247/473] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:39 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1680 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:45:40.178302 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-f4c0e5b1-8fe2-4f38-95ce-f5d634106164 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:40.179176 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-f4c0e5b1-8fe2-4f38-95ce-f5d634106164 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:40.187160 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f4c0e5b1-8fe2-4f38-95ce-f5d634106164 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:40.187614 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f4c0e5b1-8fe2-4f38-95ce-f5d634106164 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:40.188383 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f4c0e5b1-8fe2-4f38-95ce-f5d634106164 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:40.188815 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f4c0e5b1-8fe2-4f38-95ce-f5d634106164 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:40.286030 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-6f1d6e56-1c04-4096-9398-cd4990559f05 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:40.286750 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-6f1d6e56-1c04-4096-9398-cd4990559f05 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:40.293628 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6f1d6e56-1c04-4096-9398-cd4990559f05 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:40.294163 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6f1d6e56-1c04-4096-9398-cd4990559f05 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:40.295006 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6f1d6e56-1c04-4096-9398-cd4990559f05 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:40.295556 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6f1d6e56-1c04-4096-9398-cd4990559f05 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:40.313630 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f4c0e5b1-8fe2-4f38-95ce-f5d634106164 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3283218fb79487491de597fdfc16916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e1bb5bd1741ae98304f809dea24f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:40.322538 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-f4c0e5b1-8fe2-4f38-95ce-f5d634106164 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 200 len: 1210 microversion: 2.1 time: 0.149611 Jun 24 09:45:40.323548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 227/474] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:40 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 1210 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:40.435996 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6f1d6e56-1c04-4096-9398-cd4990559f05 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:40.443671 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-6f1d6e56-1c04-4096-9398-cd4990559f05 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.161615 Jun 24 09:45:40.444241 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 248/475] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:40 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:40.465773 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-5e2a781e-c594-40c2-849c-1fd7ae4d6118 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:40.466384 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-5e2a781e-c594-40c2-849c-1fd7ae4d6118 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:40.472513 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5e2a781e-c594-40c2-849c-1fd7ae4d6118 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:40.472963 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5e2a781e-c594-40c2-849c-1fd7ae4d6118 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:40.473724 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5e2a781e-c594-40c2-849c-1fd7ae4d6118 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:40.474188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5e2a781e-c594-40c2-849c-1fd7ae4d6118 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:40.847594 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-9e7d9876-de58-4027-9801-72f869e00607 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:40.848214 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-9e7d9876-de58-4027-9801-72f869e00607 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:40.855432 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9e7d9876-de58-4027-9801-72f869e00607 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:40.855928 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9e7d9876-de58-4027-9801-72f869e00607 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:40.856710 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9e7d9876-de58-4027-9801-72f869e00607 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:40.857121 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9e7d9876-de58-4027-9801-72f869e00607 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:40.890572 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-5e2a781e-c594-40c2-849c-1fd7ae4d6118 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:40.898926 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-5e2a781e-c594-40c2-849c-1fd7ae4d6118 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.438569 Jun 24 09:45:40.899690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 228/476] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:40 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:40.909410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7752ac3d-b47b-400c-8c5c-ee20a022785e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:40.909410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-7752ac3d-b47b-400c-8c5c-ee20a022785e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:40.915611 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7752ac3d-b47b-400c-8c5c-ee20a022785e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:40.915976 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7752ac3d-b47b-400c-8c5c-ee20a022785e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:40.917841 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7752ac3d-b47b-400c-8c5c-ee20a022785e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:40.918365 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7752ac3d-b47b-400c-8c5c-ee20a022785e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:41.057108 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-9e7d9876-de58-4027-9801-72f869e00607 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:41.066286 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-9e7d9876-de58-4027-9801-72f869e00607 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:41.067816 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-9e7d9876-de58-4027-9801-72f869e00607 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:41.068979 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-9e7d9876-de58-4027-9801-72f869e00607 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.225881 Jun 24 09:45:41.069536 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 249/477] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:40 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:41.084415 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-7752ac3d-b47b-400c-8c5c-ee20a022785e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:41.093062 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-7752ac3d-b47b-400c-8c5c-ee20a022785e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1680 microversion: 2.1 time: 0.192345 Jun 24 09:45:41.093631 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 229/478] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:40 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1680 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:41.340676 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f47f9da5-18ce-4fd3-b6c0-0152fbc6e943 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:41.341323 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-f47f9da5-18ce-4fd3-b6c0-0152fbc6e943 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:41.348505 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f47f9da5-18ce-4fd3-b6c0-0152fbc6e943 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:41.348949 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f47f9da5-18ce-4fd3-b6c0-0152fbc6e943 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:41.349705 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f47f9da5-18ce-4fd3-b6c0-0152fbc6e943 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:41.350133 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f47f9da5-18ce-4fd3-b6c0-0152fbc6e943 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:41.421679 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-f47f9da5-18ce-4fd3-b6c0-0152fbc6e943 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3283218fb79487491de597fdfc16916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e1bb5bd1741ae98304f809dea24f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:41.429411 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f47f9da5-18ce-4fd3-b6c0-0152fbc6e943 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 200 len: 1266 microversion: 2.1 time: 0.093700 Jun 24 09:45:41.429993 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 250/479] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:41 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:41.460356 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-967abcb5-7be8-4562-877b-88a8556b5a23 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:41.460985 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-967abcb5-7be8-4562-877b-88a8556b5a23 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:41.467812 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-967abcb5-7be8-4562-877b-88a8556b5a23 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:41.468299 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-967abcb5-7be8-4562-877b-88a8556b5a23 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:41.469050 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-967abcb5-7be8-4562-877b-88a8556b5a23 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:41.469478 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-967abcb5-7be8-4562-877b-88a8556b5a23 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:41.609287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-967abcb5-7be8-4562-877b-88a8556b5a23 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:41.635691 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-967abcb5-7be8-4562-877b-88a8556b5a23 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.178726 Jun 24 09:45:41.638625 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 230/480] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:41 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:41.917942 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-9a7b2712-d618-4930-8d97-9e5cdf708364 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:41.918883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-9a7b2712-d618-4930-8d97-9e5cdf708364 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:41.925711 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9a7b2712-d618-4930-8d97-9e5cdf708364 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:41.926258 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9a7b2712-d618-4930-8d97-9e5cdf708364 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:41.927407 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9a7b2712-d618-4930-8d97-9e5cdf708364 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:41.927913 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9a7b2712-d618-4930-8d97-9e5cdf708364 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:42.063540 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-9a7b2712-d618-4930-8d97-9e5cdf708364 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:42.071648 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-9a7b2712-d618-4930-8d97-9e5cdf708364 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.157870 Jun 24 09:45:42.072268 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 251/481] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:41 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:42.088155 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7a34284e-e088-4a89-9361-b9957f6ab549 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:42.088855 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-7a34284e-e088-4a89-9361-b9957f6ab549 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:42.096209 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7a34284e-e088-4a89-9361-b9957f6ab549 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:42.097030 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7a34284e-e088-4a89-9361-b9957f6ab549 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:42.098047 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7a34284e-e088-4a89-9361-b9957f6ab549 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:42.099923 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7a34284e-e088-4a89-9361-b9957f6ab549 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:42.115056 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e108a9b6-b536-4f5e-a385-eeeb347c7d2d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:42.115762 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e108a9b6-b536-4f5e-a385-eeeb347c7d2d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:42.127122 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e108a9b6-b536-4f5e-a385-eeeb347c7d2d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:42.128800 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:42.130754 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e108a9b6-b536-4f5e-a385-eeeb347c7d2d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:42.134569 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e108a9b6-b536-4f5e-a385-eeeb347c7d2d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:42.135036 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e108a9b6-b536-4f5e-a385-eeeb347c7d2d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:42.487679 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e108a9b6-b536-4f5e-a385-eeeb347c7d2d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:42.497105 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-7a34284e-e088-4a89-9361-b9957f6ab549 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:42.500033 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e108a9b6-b536-4f5e-a385-eeeb347c7d2d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1680 microversion: 2.1 time: 0.393920 Jun 24 09:45:42.500719 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 252/482] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:42 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1680 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:42.508630 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7a549643-6c73-49a6-8621-09a96c62dea8 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:42.509558 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-7a549643-6c73-49a6-8621-09a96c62dea8 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:42.513149 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-7a34284e-e088-4a89-9361-b9957f6ab549 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:42.515468 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-7a34284e-e088-4a89-9361-b9957f6ab549 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:42.516685 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-7a34284e-e088-4a89-9361-b9957f6ab549 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.432556 Jun 24 09:45:42.517601 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 231/483] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:42 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:42.530032 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7a549643-6c73-49a6-8621-09a96c62dea8 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:42.530792 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7a549643-6c73-49a6-8621-09a96c62dea8 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:42.532458 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7a549643-6c73-49a6-8621-09a96c62dea8 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:42.533132 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7a549643-6c73-49a6-8621-09a96c62dea8 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:42.633718 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-323b5567-b276-4496-9357-1032627f1c23 req-d1bb591d-de58-4a58-97cc-96ca35f49e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67719189-e3da-4e2f-99cd-a136ece74789", "name": "network-vif-deleted", "tag": "a8a8d8ec-532a-4f39-a19c-dd244aecac18"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:42.645678 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-323b5567-b276-4496-9357-1032627f1c23 req-d1bb591d-de58-4a58-97cc-96ca35f49e6f service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:42.646165 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-323b5567-b276-4496-9357-1032627f1c23 req-d1bb591d-de58-4a58-97cc-96ca35f49e6f service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:42.662364 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-323b5567-b276-4496-9357-1032627f1c23 req-d1bb591d-de58-4a58-97cc-96ca35f49e6f service nova] Creating event network-vif-deleted:a8a8d8ec-532a-4f39-a19c-dd244aecac18 for instance 67719189-e3da-4e2f-99cd-a136ece74789 on hv-cinder-80382 Jun 24 09:45:42.674164 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-323b5567-b276-4496-9357-1032627f1c23 req-d1bb591d-de58-4a58-97cc-96ca35f49e6f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045304 Jun 24 09:45:42.675523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 232/484] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:45:42.683143 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7560fa84-3989-42e6-9ee8-8c4a525e7fba tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:42.693345 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-7a549643-6c73-49a6-8621-09a96c62dea8 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3283218fb79487491de597fdfc16916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e1bb5bd1741ae98304f809dea24f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:42.698740 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-7560fa84-3989-42e6-9ee8-8c4a525e7fba tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:42.711793 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7560fa84-3989-42e6-9ee8-8c4a525e7fba tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:42.712964 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-7a549643-6c73-49a6-8621-09a96c62dea8 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 200 len: 1272 microversion: 2.1 time: 0.210966 Jun 24 09:45:42.713738 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7560fa84-3989-42e6-9ee8-8c4a525e7fba tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:42.715655 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 253/485] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:42 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 1272 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:42.716839 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7560fa84-3989-42e6-9ee8-8c4a525e7fba tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:42.717423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7560fa84-3989-42e6-9ee8-8c4a525e7fba tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:42.722417 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1276a068-126c-48e3-ac66-a0a9cdc15b3e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:42.724652 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-1276a068-126c-48e3-ac66-a0a9cdc15b3e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:42.732559 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1276a068-126c-48e3-ac66-a0a9cdc15b3e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:42.733252 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1276a068-126c-48e3-ac66-a0a9cdc15b3e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:42.735351 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1276a068-126c-48e3-ac66-a0a9cdc15b3e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:42.736496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1276a068-126c-48e3-ac66-a0a9cdc15b3e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:42.768793 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.objects.instance [None req-1276a068-126c-48e3-ac66-a0a9cdc15b3e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lazy-loading 'flavor' on Instance uuid 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 {{(pid=124339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:45:42.922035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:42.952638 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-1276a068-126c-48e3-ac66-a0a9cdc15b3e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "POST /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/action" status: 200 len: 32 microversion: 2.1 time: 0.235267 Jun 24 09:45:42.953255 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 254/486] 10.222.0.65 () {60 vars in 1277 bytes} [Fri Jun 24 09:45:42 2022] POST /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/action => generated 32 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 09:45:42.964439 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-68caedc0-f283-4ea4-a68e-4179fe79f6b3 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:42.964747 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-68caedc0-f283-4ea4-a68e-4179fe79f6b3 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:42.972934 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-68caedc0-f283-4ea4-a68e-4179fe79f6b3 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:42.973472 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-68caedc0-f283-4ea4-a68e-4179fe79f6b3 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:42.974875 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-68caedc0-f283-4ea4-a68e-4179fe79f6b3 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:42.974875 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-68caedc0-f283-4ea4-a68e-4179fe79f6b3 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:42.989239 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-7560fa84-3989-42e6-9ee8-8c4a525e7fba tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:43.001444 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-7560fa84-3989-42e6-9ee8-8c4a525e7fba tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1358 microversion: 2.1 time: 0.323865 Jun 24 09:45:43.002434 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 233/487] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:42 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1358 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:43.089783 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-d7f64971-2581-4b5a-9a21-f8c8adbe0895 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:43.091091 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-d7f64971-2581-4b5a-9a21-f8c8adbe0895 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:43.100050 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d7f64971-2581-4b5a-9a21-f8c8adbe0895 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:43.101146 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d7f64971-2581-4b5a-9a21-f8c8adbe0895 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:43.102091 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d7f64971-2581-4b5a-9a21-f8c8adbe0895 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:43.102680 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d7f64971-2581-4b5a-9a21-f8c8adbe0895 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:43.223501 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-68caedc0-f283-4ea4-a68e-4179fe79f6b3 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:43.232020 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-68caedc0-f283-4ea4-a68e-4179fe79f6b3 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.273134 Jun 24 09:45:43.242048 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 255/488] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:42 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:45:43.349456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d7f64971-2581-4b5a-9a21-f8c8adbe0895 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:43.358929 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-d7f64971-2581-4b5a-9a21-f8c8adbe0895 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.273268 Jun 24 09:45:43.359483 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 234/489] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:43 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:43.517681 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-0df87688-2bec-48da-b059-eff6611a9893 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:43.518482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-0df87688-2bec-48da-b059-eff6611a9893 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:43.531534 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0df87688-2bec-48da-b059-eff6611a9893 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:43.532323 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0df87688-2bec-48da-b059-eff6611a9893 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:43.533610 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0df87688-2bec-48da-b059-eff6611a9893 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:43.534322 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0df87688-2bec-48da-b059-eff6611a9893 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:43.535731 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-9a13f180-508a-44b2-86f7-b02613ee4844 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:43.536357 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-9a13f180-508a-44b2-86f7-b02613ee4844 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:43.538629 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=2 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:43.539347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=6 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:43.555942 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9a13f180-508a-44b2-86f7-b02613ee4844 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:43.556392 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9a13f180-508a-44b2-86f7-b02613ee4844 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:43.557174 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9a13f180-508a-44b2-86f7-b02613ee4844 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:43.557608 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9a13f180-508a-44b2-86f7-b02613ee4844 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:43.587407 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=2 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:43.676548 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-0df87688-2bec-48da-b059-eff6611a9893 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:43.691684 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-0df87688-2bec-48da-b059-eff6611a9893 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 200 len: 1326 microversion: 2.1 time: 0.176869 Jun 24 09:45:43.694008 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 256/490] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:43 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 1326 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:43.733627 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-07e07506-e2bc-4870-b387-f4b5b3714091 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:43.734258 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-07e07506-e2bc-4870-b387-f4b5b3714091 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:43.747035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-07e07506-e2bc-4870-b387-f4b5b3714091 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:43.747408 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-07e07506-e2bc-4870-b387-f4b5b3714091 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:43.748199 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-07e07506-e2bc-4870-b387-f4b5b3714091 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:43.749170 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-07e07506-e2bc-4870-b387-f4b5b3714091 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:43.849658 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-9a13f180-508a-44b2-86f7-b02613ee4844 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:43.865139 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-9a13f180-508a-44b2-86f7-b02613ee4844 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:43.867859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-9a13f180-508a-44b2-86f7-b02613ee4844 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:43.869740 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-9a13f180-508a-44b2-86f7-b02613ee4844 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.338141 Jun 24 09:45:43.871023 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 235/491] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:43 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:45:44.025024 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-44d040b9-9d9d-498c-af17-88167ce9fb9e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:44.025915 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-44d040b9-9d9d-498c-af17-88167ce9fb9e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:44.034007 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-44d040b9-9d9d-498c-af17-88167ce9fb9e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:44.034836 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-44d040b9-9d9d-498c-af17-88167ce9fb9e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:44.035909 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-44d040b9-9d9d-498c-af17-88167ce9fb9e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:44.036562 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-44d040b9-9d9d-498c-af17-88167ce9fb9e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:44.074614 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-07e07506-e2bc-4870-b387-f4b5b3714091 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3283218fb79487491de597fdfc16916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e1bb5bd1741ae98304f809dea24f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:44.083129 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-07e07506-e2bc-4870-b387-f4b5b3714091 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 200 len: 1314 microversion: 2.1 time: 0.354475 Jun 24 09:45:44.084334 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 257/492] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:43 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:45:44.252907 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e41c7539-9554-4314-a8fd-b8e313204ea0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:44.253079 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e41c7539-9554-4314-a8fd-b8e313204ea0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:44.259414 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e41c7539-9554-4314-a8fd-b8e313204ea0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:44.271394 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e41c7539-9554-4314-a8fd-b8e313204ea0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:44.272449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e41c7539-9554-4314-a8fd-b8e313204ea0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:44.272907 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e41c7539-9554-4314-a8fd-b8e313204ea0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:44.422281 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-44d040b9-9d9d-498c-af17-88167ce9fb9e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:44.434121 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-44d040b9-9d9d-498c-af17-88167ce9fb9e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1548 microversion: 2.1 time: 0.415612 Jun 24 09:45:44.434792 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 236/493] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:44 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1548 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:44.445813 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-d410ceab-31cb-4ec3-b273-01cf9979e56f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:44.445813 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-d410ceab-31cb-4ec3-b273-01cf9979e56f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:44.452367 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d410ceab-31cb-4ec3-b273-01cf9979e56f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:44.452898 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d410ceab-31cb-4ec3-b273-01cf9979e56f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:44.453585 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d410ceab-31cb-4ec3-b273-01cf9979e56f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:44.454020 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d410ceab-31cb-4ec3-b273-01cf9979e56f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:44.783407 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e41c7539-9554-4314-a8fd-b8e313204ea0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:44.795822 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e41c7539-9554-4314-a8fd-b8e313204ea0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.549353 Jun 24 09:45:44.798331 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 258/494] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:44 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:44.804363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e07b51d5-d803-4a27-9a06-f8f4d427ed5e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:44.805502 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e07b51d5-d803-4a27-9a06-f8f4d427ed5e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:44.814082 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e07b51d5-d803-4a27-9a06-f8f4d427ed5e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:44.815705 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e07b51d5-d803-4a27-9a06-f8f4d427ed5e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:44.816624 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e07b51d5-d803-4a27-9a06-f8f4d427ed5e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:44.817429 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e07b51d5-d803-4a27-9a06-f8f4d427ed5e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:45.221018 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d410ceab-31cb-4ec3-b273-01cf9979e56f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:45.231248 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-d410ceab-31cb-4ec3-b273-01cf9979e56f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.795352 Jun 24 09:45:45.231894 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 237/495] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:44 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:45.236613 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-48aea6aa-35e6-46cb-a0ae-462bb6977fa8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:45.237431 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-48aea6aa-35e6-46cb-a0ae-462bb6977fa8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:45.245004 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-48aea6aa-35e6-46cb-a0ae-462bb6977fa8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:45.245697 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-48aea6aa-35e6-46cb-a0ae-462bb6977fa8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:45.246661 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-48aea6aa-35e6-46cb-a0ae-462bb6977fa8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:45.247332 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-48aea6aa-35e6-46cb-a0ae-462bb6977fa8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:45.269297 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.wsgi [None req-48aea6aa-35e6-46cb-a0ae-462bb6977fa8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] HTTP exception thrown: Instance 67719189-e3da-4e2f-99cd-a136ece74789 could not be found. Jun 24 09:45:45.271188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-48aea6aa-35e6-46cb-a0ae-462bb6977fa8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Request method failure captured: Jun 24 09:45:45.271188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 HTTP/1.1 Jun 24 09:45:45.271188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:45:45.271188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:45:45.271188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:45:45.271188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 0 Jun 24 09:45:45.271188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:45:45.271188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:45:45.271188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:45:45.271188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:45:45.271188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYbvJ3i86IfpBOV1GhbK6BjjMPGc6Tm1uaFsF_cm2jflXXzg3yQgcdVgGx8TFBVweDptNaGL-vvoreBeBGl_GS39sHCNfkE3V7sePQxiYoI7e3NRcV5C6bE6H-sdZ6Daa5bOcdZzQqk3HMpLiyCtZEkhPHZ6MJeA9vI9pz9NKdB8VSk Jun 24 09:45:45.271188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:45:45.271188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:45:45.271188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:45:45.271188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:45:45.271188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:45:45.271188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:45:45.271188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:45:45.271188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:45:45.271188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:45:45.271188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:45:45.272718 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_30033ce42b5a43b78dde38163831cea2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:45:45.272718 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:45:45.272718 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:45:45.272718 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:45:45.272718 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:45:45.272718 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:45:45.272718 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:45:45.272718 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: fd136fcda9a04a16b258301a86bde8ef Jun 24 09:45:45.272718 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:45:45.272718 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: > Jun 24 09:45:45.272718 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Instance 67719189-e3da-4e2f-99cd-a136ece74789 could not be found. Jun 24 09:45:45.272718 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'id': '67719189-e3da-4e2f-99cd-a136ece74789'} Jun 24 09:45:45.273456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:45:45.273456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:45:45.273456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:45:45.273456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:45:45.273456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:45:45.273456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:45:45.273456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:45:45.273456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:45:45.273456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:45:45.273456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:45:45.273456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67719189-e3da-4e2f-99cd-a136ece74789 could not be found. Jun 24 09:45:45.273456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:45:45.273456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:45:45.273456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:45:45.273456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:45:45.273456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:45:45.273456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:45:45.273456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:45:45.273456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:45:45.273456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:45:45.274673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:45:45.274673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:45:45.274673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:45:45.274673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:45:45.274673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:45:45.274673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:45:45.274673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:45:45.274673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67719189-e3da-4e2f-99cd-a136ece74789 could not be found. Jun 24 09:45:45.274673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:45:45.274673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:45:45.274673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:45:45.274673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:45:45.274673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:45:45.274673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:45:45.274673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:45:45.274673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:45:45.274673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67719189-e3da-4e2f-99cd-a136ece74789 could not be found. Jun 24 09:45:45.274673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:45:45.277811 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-48aea6aa-35e6-46cb-a0ae-462bb6977fa8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Returning 404 to user: Instance 67719189-e3da-4e2f-99cd-a136ece74789 could not be found. {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:45:45.277811 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-48aea6aa-35e6-46cb-a0ae-462bb6977fa8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 404 len: 111 microversion: 2.1 time: 0.040862 Jun 24 09:45:45.277811 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 238/496] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:45 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:45:45.280802 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-36400fe9-0d4f-4b19-993b-ddd7705a9753 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:45.281793 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-36400fe9-0d4f-4b19-993b-ddd7705a9753 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:45.289058 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-36400fe9-0d4f-4b19-993b-ddd7705a9753 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:45.289520 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-36400fe9-0d4f-4b19-993b-ddd7705a9753 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:45.290321 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-36400fe9-0d4f-4b19-993b-ddd7705a9753 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:45.291925 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-36400fe9-0d4f-4b19-993b-ddd7705a9753 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:45.474211 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e07b51d5-d803-4a27-9a06-f8f4d427ed5e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:45.489133 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e07b51d5-d803-4a27-9a06-f8f4d427ed5e tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1548 microversion: 2.1 time: 0.689275 Jun 24 09:45:45.490292 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 259/497] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:44 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1548 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:45.495278 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-4f725e2e-d54c-4d3c-b3df-b4e975855dfe req-83d137e2-8392-4994-b3a8-1a4db52650c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa551ac0-154e-4145-acc0-725155004e69", "name": "network-vif-plugged", "status": "completed", "tag": "371d87f0-d828-436b-a673-c5e34fc40e6c"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:45.504993 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-4f725e2e-d54c-4d3c-b3df-b4e975855dfe req-83d137e2-8392-4994-b3a8-1a4db52650c0 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:45.505732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-4f725e2e-d54c-4d3c-b3df-b4e975855dfe req-83d137e2-8392-4994-b3a8-1a4db52650c0 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:45.518869 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-4f725e2e-d54c-4d3c-b3df-b4e975855dfe req-83d137e2-8392-4994-b3a8-1a4db52650c0 service nova] Creating event network-vif-plugged:371d87f0-d828-436b-a673-c5e34fc40e6c for instance aa551ac0-154e-4145-acc0-725155004e69 on hv-cinder-80382 Jun 24 09:45:45.524059 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-4f725e2e-d54c-4d3c-b3df-b4e975855dfe req-83d137e2-8392-4994-b3a8-1a4db52650c0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032361 Jun 24 09:45:45.525098 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 260/498] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:45:45.532000 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7fcb7912-2fa0-412e-981b-a996e837bc99 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:45.533897 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-7fcb7912-2fa0-412e-981b-a996e837bc99 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:45.542193 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7fcb7912-2fa0-412e-981b-a996e837bc99 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:45.542693 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7fcb7912-2fa0-412e-981b-a996e837bc99 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:45.543678 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7fcb7912-2fa0-412e-981b-a996e837bc99 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:45.544286 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7fcb7912-2fa0-412e-981b-a996e837bc99 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:45.665574 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-36400fe9-0d4f-4b19-993b-ddd7705a9753 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:45.674889 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-36400fe9-0d4f-4b19-993b-ddd7705a9753 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:45.676432 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-36400fe9-0d4f-4b19-993b-ddd7705a9753 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:45.677597 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-36400fe9-0d4f-4b19-993b-ddd7705a9753 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.401604 Jun 24 09:45:45.678123 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 239/499] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:45 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:45.682724 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-65ad3e2e-f2cc-4ace-a572-4bc39c3e6408 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '.version_select at 0x7fc6d4c3d430>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:45.703399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-65ad3e2e-f2cc-4ace-a572-4bc39c3e6408 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1891383858" status: 202 len: 0 microversion: 2.1 time: 0.024134 Jun 24 09:45:45.703994 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 240/500] 10.222.0.65 () {58 vars in 1220 bytes} [Fri Jun 24 09:45:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1891383858 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:45:45.708590 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-f7ec2dfb-ec3c-4735-a881-56692e7f013d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:45.712196 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f7ec2dfb-ec3c-4735-a881-56692e7f013d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:45.713036 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-f7ec2dfb-ec3c-4735-a881-56692e7f013d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Searching by: {'deleted': False, 'project_id': 'a0aff51028ec477ebbc12e078174977a'} {{(pid=124338) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 24 09:45:45.722738 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f7ec2dfb-ec3c-4735-a881-56692e7f013d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:45.723127 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f7ec2dfb-ec3c-4735-a881-56692e7f013d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:45.724170 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f7ec2dfb-ec3c-4735-a881-56692e7f013d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:45.724578 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f7ec2dfb-ec3c-4735-a881-56692e7f013d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:45.800523 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-7fcb7912-2fa0-412e-981b-a996e837bc99 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3283218fb79487491de597fdfc16916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e1bb5bd1741ae98304f809dea24f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:45.818466 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.multi_cell_list [None req-f7ec2dfb-ec3c-4735-a881-56692e7f013d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 24 09:45:45.825176 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-7fcb7912-2fa0-412e-981b-a996e837bc99 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 200 len: 1314 microversion: 2.1 time: 0.298565 Jun 24 09:45:45.826064 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 261/501] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:45 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:45.830998 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-7487583a-7beb-433d-9e0d-003ac099f85f req-bad689f6-1230-4d30-8b33-0d315e8b591a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d", "tag": "8bb30a85-c910-4956-a948-de9e8499b925"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:45.840767 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-7487583a-7beb-433d-9e0d-003ac099f85f req-bad689f6-1230-4d30-8b33-0d315e8b591a service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:45.841588 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-7487583a-7beb-433d-9e0d-003ac099f85f req-bad689f6-1230-4d30-8b33-0d315e8b591a service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:45.856334 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-7487583a-7beb-433d-9e0d-003ac099f85f req-bad689f6-1230-4d30-8b33-0d315e8b591a service nova] Creating event network-changed:8bb30a85-c910-4956-a948-de9e8499b925 for instance 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d on hv-cinder-80382 Jun 24 09:45:45.863686 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-7487583a-7beb-433d-9e0d-003ac099f85f req-bad689f6-1230-4d30-8b33-0d315e8b591a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035826 Jun 24 09:45:45.864761 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 262/502] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:45:45.870787 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-167df2f9-4921-4443-b756-f276e78a2dc2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:45.873022 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-167df2f9-4921-4443-b756-f276e78a2dc2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:45.880120 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-167df2f9-4921-4443-b756-f276e78a2dc2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:45.881013 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-167df2f9-4921-4443-b756-f276e78a2dc2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:45.882393 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-167df2f9-4921-4443-b756-f276e78a2dc2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:45.883245 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-167df2f9-4921-4443-b756-f276e78a2dc2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:45.972588 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-f7ec2dfb-ec3c-4735-a881-56692e7f013d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.267508 Jun 24 09:45:45.973809 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 241/503] 10.222.0.65 () {58 vars in 1124 bytes} [Fri Jun 24 09:45:45 2022] GET /compute/v2.1/servers => generated 343 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:45:45.985879 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-832fd85a-8d38-428a-ad62-5935a0a34bf1 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:45.986824 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-832fd85a-8d38-428a-ad62-5935a0a34bf1 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:46.000000 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-832fd85a-8d38-428a-ad62-5935a0a34bf1 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:46.001231 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-832fd85a-8d38-428a-ad62-5935a0a34bf1 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:46.002554 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-832fd85a-8d38-428a-ad62-5935a0a34bf1 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:46.003158 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-832fd85a-8d38-428a-ad62-5935a0a34bf1 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:46.316561 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-167df2f9-4921-4443-b756-f276e78a2dc2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:46.324859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-167df2f9-4921-4443-b756-f276e78a2dc2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.458582 Jun 24 09:45:46.325342 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 263/504] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:45 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:46.329984 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4f75fc88-4bce-4584-b817-1daf30cb0c94 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:46.331437 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-4f75fc88-4bce-4584-b817-1daf30cb0c94 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:46.337976 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4f75fc88-4bce-4584-b817-1daf30cb0c94 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:46.338423 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4f75fc88-4bce-4584-b817-1daf30cb0c94 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:46.339232 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4f75fc88-4bce-4584-b817-1daf30cb0c94 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:46.339766 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4f75fc88-4bce-4584-b817-1daf30cb0c94 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:46.362622 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-832fd85a-8d38-428a-ad62-5935a0a34bf1 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:46.370895 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-832fd85a-8d38-428a-ad62-5935a0a34bf1 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1548 microversion: 2.1 time: 0.390575 Jun 24 09:45:46.371979 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 242/505] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:45 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1548 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:45:46.504582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4f75fc88-4bce-4584-b817-1daf30cb0c94 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:46.531782 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-4f75fc88-4bce-4584-b817-1daf30cb0c94 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.204975 Jun 24 09:45:46.543442 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 264/506] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:46 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:46.686693 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-9bb2faa8-40e7-4c1b-98e3-3cf084d1ad48 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:46.687617 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-9bb2faa8-40e7-4c1b-98e3-3cf084d1ad48 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:46.699490 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-62a4b257-d17b-4e52-9d32-ffd8dfaba2b0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:46.700853 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-62a4b257-d17b-4e52-9d32-ffd8dfaba2b0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:46.707588 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9bb2faa8-40e7-4c1b-98e3-3cf084d1ad48 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:46.716120 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-62a4b257-d17b-4e52-9d32-ffd8dfaba2b0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:46.716768 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9bb2faa8-40e7-4c1b-98e3-3cf084d1ad48 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:46.718281 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-62a4b257-d17b-4e52-9d32-ffd8dfaba2b0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:46.719028 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9bb2faa8-40e7-4c1b-98e3-3cf084d1ad48 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:46.719915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-62a4b257-d17b-4e52-9d32-ffd8dfaba2b0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:46.720457 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9bb2faa8-40e7-4c1b-98e3-3cf084d1ad48 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:46.721625 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-62a4b257-d17b-4e52-9d32-ffd8dfaba2b0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:46.858559 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.objects.instance [None req-9bb2faa8-40e7-4c1b-98e3-3cf084d1ad48 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lazy-loading 'services' on Instance uuid 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef {{(pid=124338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:45:46.925616 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-62a4b257-d17b-4e52-9d32-ffd8dfaba2b0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:46.935061 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-62a4b257-d17b-4e52-9d32-ffd8dfaba2b0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:46.937293 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-62a4b257-d17b-4e52-9d32-ffd8dfaba2b0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:46.937457 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-9bb2faa8-40e7-4c1b-98e3-3cf084d1ad48 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "DELETE /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef/os-volume_attachments/519d9c43-fb95-426e-bbe1-6d82343cc12d" status: 202 len: 0 microversion: 2.1 time: 0.258058 Jun 24 09:45:46.937989 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 243/507] 10.222.0.65 () {58 vars in 1415 bytes} [Fri Jun 24 09:45:46 2022] DELETE /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef/os-volume_attachments/519d9c43-fb95-426e-bbe1-6d82343cc12d => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:45:46.938474 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-62a4b257-d17b-4e52-9d32-ffd8dfaba2b0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.244602 Jun 24 09:45:46.939328 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 265/508] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:46 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:46.946030 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3621af58-0c2b-4b73-874d-e87b86e62c46 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:46.947033 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3621af58-0c2b-4b73-874d-e87b86e62c46 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:46.953965 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-008f2c31-db65-46a8-b28a-a33f226c6ba1 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:46.954458 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3621af58-0c2b-4b73-874d-e87b86e62c46 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:46.954671 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-008f2c31-db65-46a8-b28a-a33f226c6ba1 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:46.955344 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3621af58-0c2b-4b73-874d-e87b86e62c46 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:46.956204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3621af58-0c2b-4b73-874d-e87b86e62c46 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:46.956696 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3621af58-0c2b-4b73-874d-e87b86e62c46 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:46.961143 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-008f2c31-db65-46a8-b28a-a33f226c6ba1 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:46.961586 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-008f2c31-db65-46a8-b28a-a33f226c6ba1 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:46.962344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-008f2c31-db65-46a8-b28a-a33f226c6ba1 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:46.962791 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-008f2c31-db65-46a8-b28a-a33f226c6ba1 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:46.988084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3621af58-0c2b-4b73-874d-e87b86e62c46 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045716 Jun 24 09:45:46.988644 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 266/509] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:45:46 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:45:47.104256 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-008f2c31-db65-46a8-b28a-a33f226c6ba1 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3283218fb79487491de597fdfc16916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e1bb5bd1741ae98304f809dea24f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:47.115833 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-008f2c31-db65-46a8-b28a-a33f226c6ba1 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 200 len: 1314 microversion: 2.1 time: 0.176496 Jun 24 09:45:47.116577 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 244/510] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:46 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:47.342313 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3a0ba378-2f6d-491e-817f-256f43b3bb3a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:47.342925 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3a0ba378-2f6d-491e-817f-256f43b3bb3a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:47.349550 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3a0ba378-2f6d-491e-817f-256f43b3bb3a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:47.350404 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3a0ba378-2f6d-491e-817f-256f43b3bb3a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:47.351191 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3a0ba378-2f6d-491e-817f-256f43b3bb3a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:47.351641 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3a0ba378-2f6d-491e-817f-256f43b3bb3a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:47.493959 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3a0ba378-2f6d-491e-817f-256f43b3bb3a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:47.502903 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3a0ba378-2f6d-491e-817f-256f43b3bb3a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.164666 Jun 24 09:45:47.503507 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 267/511] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:47 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:47.541007 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-8f89e915-b14a-4281-b711-92bffe11d5b3 req-1d368aae-e436-4aa4-90d9-2801f77f3418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9395b1a-996b-49cf-93c7-44f262a92968", "name": "network-vif-plugged", "status": "completed", "tag": "a1b8e69a-e08f-4ca9-bfeb-3053eac1f832"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:47.548643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-20e89407-89c0-4356-bd6d-1d6645290591 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:47.549267 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-20e89407-89c0-4356-bd6d-1d6645290591 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:47.549859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-8f89e915-b14a-4281-b711-92bffe11d5b3 req-1d368aae-e436-4aa4-90d9-2801f77f3418 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:47.550302 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-8f89e915-b14a-4281-b711-92bffe11d5b3 req-1d368aae-e436-4aa4-90d9-2801f77f3418 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:47.556460 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-20e89407-89c0-4356-bd6d-1d6645290591 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:47.556912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-20e89407-89c0-4356-bd6d-1d6645290591 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:47.557680 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-20e89407-89c0-4356-bd6d-1d6645290591 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:47.558116 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-20e89407-89c0-4356-bd6d-1d6645290591 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:47.562219 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-8f89e915-b14a-4281-b711-92bffe11d5b3 req-1d368aae-e436-4aa4-90d9-2801f77f3418 service nova] Creating event network-vif-plugged:a1b8e69a-e08f-4ca9-bfeb-3053eac1f832 for instance a9395b1a-996b-49cf-93c7-44f262a92968 on hv-cinder-80382 Jun 24 09:45:47.567318 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-8f89e915-b14a-4281-b711-92bffe11d5b3 req-1d368aae-e436-4aa4-90d9-2801f77f3418 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029958 Jun 24 09:45:47.567923 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 245/512] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:45:47.702692 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-20e89407-89c0-4356-bd6d-1d6645290591 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:47.714182 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-20e89407-89c0-4356-bd6d-1d6645290591 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.169120 Jun 24 09:45:47.714909 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 268/513] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:47 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:47.958190 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-867d64c4-e043-45b8-9867-dc8cc7a2d090 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:47.959153 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-867d64c4-e043-45b8-9867-dc8cc7a2d090 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:47.965933 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-867d64c4-e043-45b8-9867-dc8cc7a2d090 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:47.966370 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-867d64c4-e043-45b8-9867-dc8cc7a2d090 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:47.967336 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-867d64c4-e043-45b8-9867-dc8cc7a2d090 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:47.968080 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-867d64c4-e043-45b8-9867-dc8cc7a2d090 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:48.003843 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-ed313750-3344-4321-9d60-1eb95b37cc21 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:48.004932 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-ed313750-3344-4321-9d60-1eb95b37cc21 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:48.013581 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ed313750-3344-4321-9d60-1eb95b37cc21 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:48.013581 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ed313750-3344-4321-9d60-1eb95b37cc21 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:48.013581 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ed313750-3344-4321-9d60-1eb95b37cc21 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:48.013967 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ed313750-3344-4321-9d60-1eb95b37cc21 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:48.047341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-ed313750-3344-4321-9d60-1eb95b37cc21 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051167 Jun 24 09:45:48.047921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 269/514] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:45:47 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:45:48.052753 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-9fba6094-ef25-49a2-a35d-c9c7636e8d31 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff169ce7-4266-4222-838f-821ec0b4e651"}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:48.053815 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-9fba6094-ef25-49a2-a35d-c9c7636e8d31 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:48.060569 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9fba6094-ef25-49a2-a35d-c9c7636e8d31 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:48.061010 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9fba6094-ef25-49a2-a35d-c9c7636e8d31 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:48.061779 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9fba6094-ef25-49a2-a35d-c9c7636e8d31 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:48.062209 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9fba6094-ef25-49a2-a35d-c9c7636e8d31 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:48.114357 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-867d64c4-e043-45b8-9867-dc8cc7a2d090 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:48.123475 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-867d64c4-e043-45b8-9867-dc8cc7a2d090 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:48.124981 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-867d64c4-e043-45b8-9867-dc8cc7a2d090 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:48.126163 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-867d64c4-e043-45b8-9867-dc8cc7a2d090 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.172293 Jun 24 09:45:48.126723 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 246/515] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:47 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:48.140447 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-8c94c28b-24f5-451d-97c1-63428cef7fba tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:48.141274 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-8c94c28b-24f5-451d-97c1-63428cef7fba tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:48.148445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8c94c28b-24f5-451d-97c1-63428cef7fba tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:48.149000 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8c94c28b-24f5-451d-97c1-63428cef7fba tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:48.150004 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8c94c28b-24f5-451d-97c1-63428cef7fba tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:48.150721 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8c94c28b-24f5-451d-97c1-63428cef7fba tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:48.284530 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-8c94c28b-24f5-451d-97c1-63428cef7fba tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3283218fb79487491de597fdfc16916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e1bb5bd1741ae98304f809dea24f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:48.294254 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-8c94c28b-24f5-451d-97c1-63428cef7fba tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 200 len: 1314 microversion: 2.1 time: 0.164607 Jun 24 09:45:48.305054 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 247/516] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:48 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:48.517112 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-9fba6094-ef25-49a2-a35d-c9c7636e8d31 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "POST /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.467639 Jun 24 09:45:48.522144 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 270/517] 10.222.0.65 () {60 vars in 1322 bytes} [Fri Jun 24 09:45:48 2022] POST /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/os-volume_attachments => generated 194 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:45:48.522327 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-3a709b79-2063-4fc0-b7f9-2487d5876583 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:48.522327 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-3a709b79-2063-4fc0-b7f9-2487d5876583 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:48.533941 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3a709b79-2063-4fc0-b7f9-2487d5876583 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:48.534423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3a709b79-2063-4fc0-b7f9-2487d5876583 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:48.535331 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3a709b79-2063-4fc0-b7f9-2487d5876583 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:48.535766 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3a709b79-2063-4fc0-b7f9-2487d5876583 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:48.674752 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-3a709b79-2063-4fc0-b7f9-2487d5876583 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:48.682845 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-3a709b79-2063-4fc0-b7f9-2487d5876583 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.165900 Jun 24 09:45:48.684184 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 248/518] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:48 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:45:48.732922 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-77949eb6-5179-41b9-90ab-e0aa0abcf2f7 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:48.733616 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-77949eb6-5179-41b9-90ab-e0aa0abcf2f7 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:48.740451 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-77949eb6-5179-41b9-90ab-e0aa0abcf2f7 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:48.740894 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-77949eb6-5179-41b9-90ab-e0aa0abcf2f7 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:48.741634 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-77949eb6-5179-41b9-90ab-e0aa0abcf2f7 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:48.742125 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-77949eb6-5179-41b9-90ab-e0aa0abcf2f7 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:48.746572 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:48.884728 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-77949eb6-5179-41b9-90ab-e0aa0abcf2f7 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:48.893575 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-77949eb6-5179-41b9-90ab-e0aa0abcf2f7 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.165367 Jun 24 09:45:48.894142 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 271/519] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:48 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:49.059696 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-854a7885-b71e-4771-a862-7297cca7237d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:49.061730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-854a7885-b71e-4771-a862-7297cca7237d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:49.071331 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-854a7885-b71e-4771-a862-7297cca7237d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:49.072067 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-854a7885-b71e-4771-a862-7297cca7237d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:49.073321 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-854a7885-b71e-4771-a862-7297cca7237d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:49.074034 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-854a7885-b71e-4771-a862-7297cca7237d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:49.107145 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-854a7885-b71e-4771-a862-7297cca7237d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051778 Jun 24 09:45:49.107712 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 249/520] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:45:49 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:45:49.145937 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3258f373-cc44-4cb0-8245-0c2cbe656e45 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:49.146523 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3258f373-cc44-4cb0-8245-0c2cbe656e45 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:49.153841 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3258f373-cc44-4cb0-8245-0c2cbe656e45 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:49.154293 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3258f373-cc44-4cb0-8245-0c2cbe656e45 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:49.155037 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3258f373-cc44-4cb0-8245-0c2cbe656e45 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:49.155493 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3258f373-cc44-4cb0-8245-0c2cbe656e45 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:49.295778 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3258f373-cc44-4cb0-8245-0c2cbe656e45 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:49.304681 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3258f373-cc44-4cb0-8245-0c2cbe656e45 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:49.306194 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3258f373-cc44-4cb0-8245-0c2cbe656e45 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:49.307688 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3258f373-cc44-4cb0-8245-0c2cbe656e45 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1807 microversion: 2.20 time: 0.165470 Jun 24 09:45:49.308252 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 272/521] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:49 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:45:49.312938 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-1d0f799e-76b2-4e87-b5d4-5c046271dc79 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:49.313463 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-1d0f799e-76b2-4e87-b5d4-5c046271dc79 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:49.320210 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1d0f799e-76b2-4e87-b5d4-5c046271dc79 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:49.320664 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1d0f799e-76b2-4e87-b5d4-5c046271dc79 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:49.321437 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1d0f799e-76b2-4e87-b5d4-5c046271dc79 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:49.321873 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1d0f799e-76b2-4e87-b5d4-5c046271dc79 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:49.326146 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:49.459357 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-1d0f799e-76b2-4e87-b5d4-5c046271dc79 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3283218fb79487491de597fdfc16916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e1bb5bd1741ae98304f809dea24f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:49.467717 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-1d0f799e-76b2-4e87-b5d4-5c046271dc79 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 200 len: 1314 microversion: 2.1 time: 0.159041 Jun 24 09:45:49.468289 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 250/522] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:49 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:45:49.701553 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-0aac4c6a-7f12-495a-bc46-9aa3a1b2b2b6 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:49.702946 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-0aac4c6a-7f12-495a-bc46-9aa3a1b2b2b6 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:49.709922 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0aac4c6a-7f12-495a-bc46-9aa3a1b2b2b6 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:49.710370 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0aac4c6a-7f12-495a-bc46-9aa3a1b2b2b6 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:49.711180 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0aac4c6a-7f12-495a-bc46-9aa3a1b2b2b6 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:49.711658 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0aac4c6a-7f12-495a-bc46-9aa3a1b2b2b6 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:49.866103 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-0aac4c6a-7f12-495a-bc46-9aa3a1b2b2b6 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:49.874483 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-0aac4c6a-7f12-495a-bc46-9aa3a1b2b2b6 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.177464 Jun 24 09:45:49.875059 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 273/523] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:49 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:49.911116 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-509860ca-8ec3-4c22-87c8-537a2ec4442d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:49.911750 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-509860ca-8ec3-4c22-87c8-537a2ec4442d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:49.918290 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-509860ca-8ec3-4c22-87c8-537a2ec4442d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:49.918732 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-509860ca-8ec3-4c22-87c8-537a2ec4442d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:49.919706 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-509860ca-8ec3-4c22-87c8-537a2ec4442d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:49.920137 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-509860ca-8ec3-4c22-87c8-537a2ec4442d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:50.069295 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-509860ca-8ec3-4c22-87c8-537a2ec4442d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:50.077744 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-509860ca-8ec3-4c22-87c8-537a2ec4442d tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.170389 Jun 24 09:45:50.078221 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 251/524] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:49 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:50.118844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b89f61d3-fa1a-48be-bf7c-9f65d84dde00 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:50.119878 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-b89f61d3-fa1a-48be-bf7c-9f65d84dde00 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:50.126949 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b89f61d3-fa1a-48be-bf7c-9f65d84dde00 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:50.127712 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b89f61d3-fa1a-48be-bf7c-9f65d84dde00 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:50.128533 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b89f61d3-fa1a-48be-bf7c-9f65d84dde00 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:50.128966 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b89f61d3-fa1a-48be-bf7c-9f65d84dde00 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:50.158752 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b89f61d3-fa1a-48be-bf7c-9f65d84dde00 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043924 Jun 24 09:45:50.159834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 274/525] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:45:50 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 09:45:50.220123 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-2fefc428-e345-4146-ba8a-b5d0b6d9e52a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:50.220615 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-2fefc428-e345-4146-ba8a-b5d0b6d9e52a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:50.229907 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2fefc428-e345-4146-ba8a-b5d0b6d9e52a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:50.230346 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2fefc428-e345-4146-ba8a-b5d0b6d9e52a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:50.231479 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2fefc428-e345-4146-ba8a-b5d0b6d9e52a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:50.231881 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2fefc428-e345-4146-ba8a-b5d0b6d9e52a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:50.258691 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-2fefc428-e345-4146-ba8a-b5d0b6d9e52a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Going to try to terminate instance {{(pid=124338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:45:50.329361 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a53e025f-6d4a-4b90-84da-43d14e0b0276 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:50.329825 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-a53e025f-6d4a-4b90-84da-43d14e0b0276 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:50.337366 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a53e025f-6d4a-4b90-84da-43d14e0b0276 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:50.338010 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a53e025f-6d4a-4b90-84da-43d14e0b0276 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:50.338913 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a53e025f-6d4a-4b90-84da-43d14e0b0276 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:50.339369 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a53e025f-6d4a-4b90-84da-43d14e0b0276 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:50.341345 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:50.350548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-2fefc428-e345-4146-ba8a-b5d0b6d9e52a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "DELETE /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 204 len: 0 microversion: 2.1 time: 0.133685 Jun 24 09:45:50.351179 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 252/526] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:45:50 2022] DELETE /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:45:50.360312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-4c8a8c42-5267-4737-97fc-203b15b19cc7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:50.361002 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-4c8a8c42-5267-4737-97fc-203b15b19cc7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:50.368269 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-4c8a8c42-5267-4737-97fc-203b15b19cc7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:50.368773 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-4c8a8c42-5267-4737-97fc-203b15b19cc7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:50.369587 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-4c8a8c42-5267-4737-97fc-203b15b19cc7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:50.370207 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-4c8a8c42-5267-4737-97fc-203b15b19cc7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:50.546679 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-a53e025f-6d4a-4b90-84da-43d14e0b0276 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:50.548958 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-4c8a8c42-5267-4737-97fc-203b15b19cc7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:50.556491 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-4c8a8c42-5267-4737-97fc-203b15b19cc7 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1681 microversion: 2.1 time: 0.200784 Jun 24 09:45:50.557211 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 253/527] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:50 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1681 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:50.562287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-751b1a4b-d6d7-4470-9b3b-aea228c05cf4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:50.562836 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-751b1a4b-d6d7-4470-9b3b-aea228c05cf4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:50.568937 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-751b1a4b-d6d7-4470-9b3b-aea228c05cf4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:50.569322 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-a53e025f-6d4a-4b90-84da-43d14e0b0276 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:50.569453 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-751b1a4b-d6d7-4470-9b3b-aea228c05cf4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:50.570146 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-751b1a4b-d6d7-4470-9b3b-aea228c05cf4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:50.570863 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-751b1a4b-d6d7-4470-9b3b-aea228c05cf4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:50.570983 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-a53e025f-6d4a-4b90-84da-43d14e0b0276 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:50.572068 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-a53e025f-6d4a-4b90-84da-43d14e0b0276 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1794 microversion: 2.20 time: 0.247568 Jun 24 09:45:50.572923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 275/528] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:45:50 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1794 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:45:50.717349 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-751b1a4b-d6d7-4470-9b3b-aea228c05cf4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3283218fb79487491de597fdfc16916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e1bb5bd1741ae98304f809dea24f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:50.727847 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-751b1a4b-d6d7-4470-9b3b-aea228c05cf4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 200 len: 1314 microversion: 2.1 time: 0.169541 Jun 24 09:45:50.734445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 254/529] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:50 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:50.896220 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-360ceeab-c6bb-4c03-9175-9168eb1bb0d7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:50.897134 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-360ceeab-c6bb-4c03-9175-9168eb1bb0d7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:50.906732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-360ceeab-c6bb-4c03-9175-9168eb1bb0d7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:50.907222 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-360ceeab-c6bb-4c03-9175-9168eb1bb0d7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:50.908020 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-360ceeab-c6bb-4c03-9175-9168eb1bb0d7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:50.908417 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-360ceeab-c6bb-4c03-9175-9168eb1bb0d7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:51.050296 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-360ceeab-c6bb-4c03-9175-9168eb1bb0d7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:51.060887 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-360ceeab-c6bb-4c03-9175-9168eb1bb0d7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.171014 Jun 24 09:45:51.061570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 276/530] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:50 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:51.094226 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-6f1047bb-8786-4d7e-9630-85f0e4621904 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:51.094844 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-6f1047bb-8786-4d7e-9630-85f0e4621904 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:51.101972 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6f1047bb-8786-4d7e-9630-85f0e4621904 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:51.102432 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6f1047bb-8786-4d7e-9630-85f0e4621904 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:51.103236 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6f1047bb-8786-4d7e-9630-85f0e4621904 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:51.103684 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6f1047bb-8786-4d7e-9630-85f0e4621904 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:51.266206 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-6f1047bb-8786-4d7e-9630-85f0e4621904 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:51.273963 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-6f1047bb-8786-4d7e-9630-85f0e4621904 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1319 microversion: 2.1 time: 0.183764 Jun 24 09:45:51.274540 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 255/531] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:51 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:51.578537 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-ec2fd83d-2907-40af-ad19-8da628f8f37e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:51.579467 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-ec2fd83d-2907-40af-ad19-8da628f8f37e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:51.589818 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ec2fd83d-2907-40af-ad19-8da628f8f37e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:51.590566 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ec2fd83d-2907-40af-ad19-8da628f8f37e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:51.591535 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ec2fd83d-2907-40af-ad19-8da628f8f37e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:51.591964 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ec2fd83d-2907-40af-ad19-8da628f8f37e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:51.743504 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ec2fd83d-2907-40af-ad19-8da628f8f37e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:51.746768 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-260b59e6-dca8-4018-a4a3-c284248c6858 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:51.747761 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-260b59e6-dca8-4018-a4a3-c284248c6858 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:51.754583 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-260b59e6-dca8-4018-a4a3-c284248c6858 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:51.755031 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-260b59e6-dca8-4018-a4a3-c284248c6858 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:51.756186 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-260b59e6-dca8-4018-a4a3-c284248c6858 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:51.756401 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-260b59e6-dca8-4018-a4a3-c284248c6858 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:51.756636 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-ec2fd83d-2907-40af-ad19-8da628f8f37e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1681 microversion: 2.1 time: 0.184852 Jun 24 09:45:51.757358 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 277/532] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:51 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1681 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:51.897544 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-260b59e6-dca8-4018-a4a3-c284248c6858 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3283218fb79487491de597fdfc16916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e1bb5bd1741ae98304f809dea24f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:51.905840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-260b59e6-dca8-4018-a4a3-c284248c6858 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 200 len: 1314 microversion: 2.1 time: 0.165047 Jun 24 09:45:51.906415 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 256/533] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:51 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:52.079642 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-9234d2e7-447b-4acc-9f12-561095c418f1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:52.080257 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-9234d2e7-447b-4acc-9f12-561095c418f1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:52.087240 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9234d2e7-447b-4acc-9f12-561095c418f1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:52.087714 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9234d2e7-447b-4acc-9f12-561095c418f1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:52.088480 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9234d2e7-447b-4acc-9f12-561095c418f1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:52.088911 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9234d2e7-447b-4acc-9f12-561095c418f1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:52.236497 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-9234d2e7-447b-4acc-9f12-561095c418f1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:52.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-9234d2e7-447b-4acc-9f12-561095c418f1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.169662 Jun 24 09:45:52.246047 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 278/534] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:52 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:52.291634 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7824f276-1879-4ed1-b052-3f0150a57fe0 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:52.292249 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-7824f276-1879-4ed1-b052-3f0150a57fe0 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:52.299307 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7824f276-1879-4ed1-b052-3f0150a57fe0 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:52.299757 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7824f276-1879-4ed1-b052-3f0150a57fe0 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:52.300602 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7824f276-1879-4ed1-b052-3f0150a57fe0 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:52.301034 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7824f276-1879-4ed1-b052-3f0150a57fe0 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:52.433752 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-7824f276-1879-4ed1-b052-3f0150a57fe0 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:52.442520 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-7824f276-1879-4ed1-b052-3f0150a57fe0 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1508 microversion: 2.1 time: 0.154913 Jun 24 09:45:52.443103 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 257/535] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:52 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:52.459661 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-77fc1e89-a1e7-4b24-a612-2096cb3b87dc tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0aba3335-0764-4332-98f8-c35bfaf86356", "device": "/dev/sdb"}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:52.460915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-77fc1e89-a1e7-4b24-a612-2096cb3b87dc tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:52.467912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-77fc1e89-a1e7-4b24-a612-2096cb3b87dc tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:52.468355 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-77fc1e89-a1e7-4b24-a612-2096cb3b87dc tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:52.469119 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-77fc1e89-a1e7-4b24-a612-2096cb3b87dc tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:52.469541 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-77fc1e89-a1e7-4b24-a612-2096cb3b87dc tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:52.714736 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-b549c8bd-68ad-4f0c-8ef3-628ca848e37d req-f23d1aca-092c-4b1d-822f-c803a3c034ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d", "name": "network-vif-plugged", "status": "completed", "tag": "8bb30a85-c910-4956-a948-de9e8499b925"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:52.725408 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-b549c8bd-68ad-4f0c-8ef3-628ca848e37d req-f23d1aca-092c-4b1d-822f-c803a3c034ba service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:52.725860 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-b549c8bd-68ad-4f0c-8ef3-628ca848e37d req-f23d1aca-092c-4b1d-822f-c803a3c034ba service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:52.778108 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-b549c8bd-68ad-4f0c-8ef3-628ca848e37d req-f23d1aca-092c-4b1d-822f-c803a3c034ba service nova] Creating event network-vif-plugged:8bb30a85-c910-4956-a948-de9e8499b925 for instance 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d on hv-cinder-80382 Jun 24 09:45:52.782993 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-b549c8bd-68ad-4f0c-8ef3-628ca848e37d req-f23d1aca-092c-4b1d-822f-c803a3c034ba service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073757 Jun 24 09:45:52.783982 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 258/536] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:45:52.789280 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-62707bcd-65dd-4356-9324-3728a206f328 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:52.789680 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-62707bcd-65dd-4356-9324-3728a206f328 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:52.796267 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-62707bcd-65dd-4356-9324-3728a206f328 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:52.796712 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-62707bcd-65dd-4356-9324-3728a206f328 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:52.797667 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-62707bcd-65dd-4356-9324-3728a206f328 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:52.798096 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-62707bcd-65dd-4356-9324-3728a206f328 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:52.890124 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-77fc1e89-a1e7-4b24-a612-2096cb3b87dc tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "POST /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.434366 Jun 24 09:45:52.895207 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 279/537] 10.222.0.65 () {60 vars in 1322 bytes} [Fri Jun 24 09:45:52 2022] POST /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968/os-volume_attachments => generated 194 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:45:52.922780 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3a17b7c5-883e-4993-a695-549aed72fde2 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:52.923364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3a17b7c5-883e-4993-a695-549aed72fde2 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:52.930327 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3a17b7c5-883e-4993-a695-549aed72fde2 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:52.930899 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3a17b7c5-883e-4993-a695-549aed72fde2 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:52.931830 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3a17b7c5-883e-4993-a695-549aed72fde2 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:52.932126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3a17b7c5-883e-4993-a695-549aed72fde2 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:52.939463 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-62707bcd-65dd-4356-9324-3728a206f328 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:52.948662 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-62707bcd-65dd-4356-9324-3728a206f328 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1681 microversion: 2.1 time: 0.163460 Jun 24 09:45:52.949261 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 259/538] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:52 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:53.170464 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3a17b7c5-883e-4993-a695-549aed72fde2 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3283218fb79487491de597fdfc16916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e1bb5bd1741ae98304f809dea24f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:53.178760 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3a17b7c5-883e-4993-a695-549aed72fde2 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 200 len: 1314 microversion: 2.1 time: 0.260552 Jun 24 09:45:53.184599 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 280/539] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:52 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:45:53.264706 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-34971aae-5370-4238-87cd-3f3c45a08dd0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:53.265585 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-34971aae-5370-4238-87cd-3f3c45a08dd0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:53.272416 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-34971aae-5370-4238-87cd-3f3c45a08dd0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:53.272864 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-34971aae-5370-4238-87cd-3f3c45a08dd0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:53.273865 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-34971aae-5370-4238-87cd-3f3c45a08dd0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:53.274304 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-34971aae-5370-4238-87cd-3f3c45a08dd0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:53.534825 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-34971aae-5370-4238-87cd-3f3c45a08dd0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:53.544783 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-34971aae-5370-4238-87cd-3f3c45a08dd0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.284659 Jun 24 09:45:53.545660 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 260/540] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:53 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:53.966405 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3dd0bbc4-ea9e-440f-b00d-0647bfa854e9 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:53.966930 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3dd0bbc4-ea9e-440f-b00d-0647bfa854e9 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:53.973910 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3dd0bbc4-ea9e-440f-b00d-0647bfa854e9 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:53.974338 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3dd0bbc4-ea9e-440f-b00d-0647bfa854e9 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:53.975529 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3dd0bbc4-ea9e-440f-b00d-0647bfa854e9 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:53.975941 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3dd0bbc4-ea9e-440f-b00d-0647bfa854e9 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:54.064791 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3dd0bbc4-ea9e-440f-b00d-0647bfa854e9 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:54.073274 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3dd0bbc4-ea9e-440f-b00d-0647bfa854e9 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1613 microversion: 2.1 time: 0.111083 Jun 24 09:45:54.083055 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 281/541] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:53 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1613 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:54.196510 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-a72059e0-4426-41bf-b5f2-191fb9020ae4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:54.197234 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-a72059e0-4426-41bf-b5f2-191fb9020ae4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:54.205452 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a72059e0-4426-41bf-b5f2-191fb9020ae4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:54.206135 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a72059e0-4426-41bf-b5f2-191fb9020ae4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:54.207010 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a72059e0-4426-41bf-b5f2-191fb9020ae4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:54.208494 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a72059e0-4426-41bf-b5f2-191fb9020ae4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:54.256492 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-1b45cb4a-5a99-4221-9df8-80ab0ff6ae0f req-9f641d94-b574-445b-8e8a-45adf6d828cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a2b7d9-c03a-459b-9ceb-5d6bf14546ef", "name": "network-vif-deleted", "tag": "cb40a2d0-f3d7-48fd-97c9-01e1ce70c8c1"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:54.267583 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-1b45cb4a-5a99-4221-9df8-80ab0ff6ae0f req-9f641d94-b574-445b-8e8a-45adf6d828cf service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:54.268282 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-1b45cb4a-5a99-4221-9df8-80ab0ff6ae0f req-9f641d94-b574-445b-8e8a-45adf6d828cf service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:54.280700 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-1b45cb4a-5a99-4221-9df8-80ab0ff6ae0f req-9f641d94-b574-445b-8e8a-45adf6d828cf service nova] Creating event network-vif-deleted:cb40a2d0-f3d7-48fd-97c9-01e1ce70c8c1 for instance 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef on hv-cinder-80382 Jun 24 09:45:54.288290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-1b45cb4a-5a99-4221-9df8-80ab0ff6ae0f req-9f641d94-b574-445b-8e8a-45adf6d828cf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035271 Jun 24 09:45:54.289202 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 282/542] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:45:54.439546 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-a72059e0-4426-41bf-b5f2-191fb9020ae4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3283218fb79487491de597fdfc16916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e1bb5bd1741ae98304f809dea24f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:54.447402 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-a72059e0-4426-41bf-b5f2-191fb9020ae4 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 200 len: 1314 microversion: 2.1 time: 0.254767 Jun 24 09:45:54.447957 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 261/543] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:54 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:54.563465 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f205dc85-1baa-4199-9865-13df84599656 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:54.564165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-f205dc85-1baa-4199-9865-13df84599656 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:54.571521 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f205dc85-1baa-4199-9865-13df84599656 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:54.571935 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f205dc85-1baa-4199-9865-13df84599656 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:54.572738 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f205dc85-1baa-4199-9865-13df84599656 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:54.573171 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f205dc85-1baa-4199-9865-13df84599656 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:54.721080 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-f205dc85-1baa-4199-9865-13df84599656 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:54.730118 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f205dc85-1baa-4199-9865-13df84599656 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.171219 Jun 24 09:45:54.730685 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 283/544] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:54 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:55.090386 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-953e7c30-e100-4771-afd3-54e0688f2b32 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:55.091625 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-953e7c30-e100-4771-afd3-54e0688f2b32 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:55.097775 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-953e7c30-e100-4771-afd3-54e0688f2b32 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:55.098283 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-953e7c30-e100-4771-afd3-54e0688f2b32 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:55.099215 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-953e7c30-e100-4771-afd3-54e0688f2b32 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:55.100047 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-953e7c30-e100-4771-afd3-54e0688f2b32 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:55.135863 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-953e7c30-e100-4771-afd3-54e0688f2b32 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:55.136308 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-953e7c30-e100-4771-afd3-54e0688f2b32 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:55.136787 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.objects.instance [None req-953e7c30-e100-4771-afd3-54e0688f2b32 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lazy-loading 'fault' on Instance uuid 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef {{(pid=124338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:45:55.179589 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-953e7c30-e100-4771-afd3-54e0688f2b32 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:55.187815 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-953e7c30-e100-4771-afd3-54e0688f2b32 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 200 len: 1331 microversion: 2.1 time: 0.101795 Jun 24 09:45:55.188441 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 262/545] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:55 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:55.465479 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-d2320274-6385-405d-b8bb-e1b1d57fa4f0 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:55.466059 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-d2320274-6385-405d-b8bb-e1b1d57fa4f0 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:55.472864 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d2320274-6385-405d-b8bb-e1b1d57fa4f0 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:55.473373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d2320274-6385-405d-b8bb-e1b1d57fa4f0 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:55.474164 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d2320274-6385-405d-b8bb-e1b1d57fa4f0 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:55.474596 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d2320274-6385-405d-b8bb-e1b1d57fa4f0 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:55.676417 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-d2320274-6385-405d-b8bb-e1b1d57fa4f0 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3283218fb79487491de597fdfc16916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e1bb5bd1741ae98304f809dea24f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:55.685004 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-d2320274-6385-405d-b8bb-e1b1d57fa4f0 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 200 len: 1464 microversion: 2.1 time: 0.223686 Jun 24 09:45:55.685602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 284/546] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:55 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 1464 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:55.725368 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-0977613c-b001-495a-b656-37b405217008 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:55.725941 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-0977613c-b001-495a-b656-37b405217008 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:55.732819 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0977613c-b001-495a-b656-37b405217008 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:55.733347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0977613c-b001-495a-b656-37b405217008 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:55.734221 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0977613c-b001-495a-b656-37b405217008 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:55.734605 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0977613c-b001-495a-b656-37b405217008 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:55.747810 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-018148a1-3757-4ebf-871e-c74e95689a49 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:55.748395 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-018148a1-3757-4ebf-871e-c74e95689a49 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:55.758259 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-018148a1-3757-4ebf-871e-c74e95689a49 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:55.759027 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-018148a1-3757-4ebf-871e-c74e95689a49 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:55.759869 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-018148a1-3757-4ebf-871e-c74e95689a49 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:55.760304 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-018148a1-3757-4ebf-871e-c74e95689a49 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:55.761966 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-0977613c-b001-495a-b656-37b405217008 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Going to try to terminate instance {{(pid=124338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:45:55.779385 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=2 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:55.821454 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:55.855262 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-0977613c-b001-495a-b656-37b405217008 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 204 len: 0 microversion: 2.1 time: 0.133896 Jun 24 09:45:55.855866 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 263/547] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:45:55 2022] DELETE /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:45:55.864629 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-58e96a90-1106-4f54-827c-421c2403f5bd tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:55.865342 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-58e96a90-1106-4f54-827c-421c2403f5bd tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:55.872017 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-58e96a90-1106-4f54-827c-421c2403f5bd tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:55.872477 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-58e96a90-1106-4f54-827c-421c2403f5bd tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:55.873253 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-58e96a90-1106-4f54-827c-421c2403f5bd tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:55.873684 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-58e96a90-1106-4f54-827c-421c2403f5bd tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:55.899430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-018148a1-3757-4ebf-871e-c74e95689a49 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:55.908263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-018148a1-3757-4ebf-871e-c74e95689a49 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.164472 Jun 24 09:45:55.908846 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 285/548] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:55 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:56.010672 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-58e96a90-1106-4f54-827c-421c2403f5bd tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3283218fb79487491de597fdfc16916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e1bb5bd1741ae98304f809dea24f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:56.018660 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-58e96a90-1106-4f54-827c-421c2403f5bd tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 200 len: 1470 microversion: 2.1 time: 0.158297 Jun 24 09:45:56.019260 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 264/549] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:55 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:56.204910 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e75994e6-41c7-4635-9bc3-88dc71877fa6 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:56.205621 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e75994e6-41c7-4635-9bc3-88dc71877fa6 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:56.212195 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e75994e6-41c7-4635-9bc3-88dc71877fa6 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:56.212645 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e75994e6-41c7-4635-9bc3-88dc71877fa6 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:56.213484 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e75994e6-41c7-4635-9bc3-88dc71877fa6 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:56.213818 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e75994e6-41c7-4635-9bc3-88dc71877fa6 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:56.233597 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-e75994e6-41c7-4635-9bc3-88dc71877fa6 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] HTTP exception thrown: Instance 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef could not be found. Jun 24 09:45:56.235204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e75994e6-41c7-4635-9bc3-88dc71877fa6 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Request method failure captured: Jun 24 09:45:56.235204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef HTTP/1.1 Jun 24 09:45:56.235204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:45:56.235204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:45:56.235204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:45:56.235204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:45:56.235204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:45:56.235204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:45:56.235204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:45:56.235204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:45:56.235204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYbvJ3i86IfpBOV1GhbK6BjjMPGc6Tm1uaFsF_cm2jflXXzg3yQgcdVgGx8TFBVweDptNaGL-vvoreBeBGl_GS39sHCNfkE3V7sePQxiYoI7e3NRcV5C6bE6H-sdZ6Daa5bOcdZzQqk3HMpLiyCtZEkhPHZ6MJeA9vI9pz9NKdB8VSk Jun 24 09:45:56.235204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:45:56.235204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:45:56.235204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:45:56.235204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:45:56.235204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:45:56.235204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:45:56.235204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:45:56.235204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:45:56.235204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:45:56.235204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:45:56.236577 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_30033ce42b5a43b78dde38163831cea2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:45:56.236577 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:45:56.236577 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:45:56.236577 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:45:56.236577 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:45:56.236577 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:45:56.236577 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:45:56.236577 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: fd136fcda9a04a16b258301a86bde8ef Jun 24 09:45:56.236577 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:45:56.236577 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:45:56.236577 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef could not be found. Jun 24 09:45:56.236577 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': '93a2b7d9-c03a-459b-9ceb-5d6bf14546ef'} Jun 24 09:45:56.237276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:45:56.237276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:45:56.237276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:45:56.237276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:45:56.237276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:45:56.237276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:45:56.237276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:45:56.237276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:45:56.237276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:45:56.237276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:45:56.237276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef could not be found. Jun 24 09:45:56.237276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:45:56.237276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:45:56.237276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:45:56.237276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:45:56.237276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:45:56.237276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:45:56.237276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:45:56.237276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:45:56.237276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:45:56.238375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:45:56.238375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:45:56.238375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:45:56.238375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:45:56.238375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:45:56.238375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:45:56.238375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:45:56.238375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef could not be found. Jun 24 09:45:56.238375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:45:56.238375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:45:56.238375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:45:56.238375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:45:56.238375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:45:56.238375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:45:56.238375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:45:56.238375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:45:56.238375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef could not be found. Jun 24 09:45:56.238375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:45:56.239424 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e75994e6-41c7-4635-9bc3-88dc71877fa6 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Returning 404 to user: Instance 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:45:56.239424 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e75994e6-41c7-4635-9bc3-88dc71877fa6 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 404 len: 111 microversion: 2.1 time: 0.035863 Jun 24 09:45:56.239424 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 286/550] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:56 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:45:56.246103 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-3fe2c0d2-fd24-47dd-944e-5f2755fa7d97 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '.version_select at 0x7fc6d4bc8e50>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:56.267198 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-3fe2c0d2-fd24-47dd-944e-5f2755fa7d97 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2072673669" status: 202 len: 0 microversion: 2.1 time: 0.024865 Jun 24 09:45:56.267755 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 265/551] 10.222.0.65 () {58 vars in 1220 bytes} [Fri Jun 24 09:45:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2072673669 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:45:56.910088 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f152ca46-6009-4650-a1d7-09d541fccc05 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Action: 'create', calling method: .version_select at 0x7fc6d462d700>, body: {"keypair": {"name": "tempest-keypair-1439492096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGX46QErKGE6dwXad3CWNJfXTWpj4aSXdlEOU3r6MAM62RgGyadDxIrmO5IX0ebMuQmo5UG3w74ZHUbTYMYCrPPPt5+ONpF3uQ7QNy1b9h2URdYMjOHtK08rxxT2wKE3jA=="}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:56.927237 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-5b9916dc-60db-4ef9-bb41-8589c9001617 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:56.927836 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-f152ca46-6009-4650-a1d7-09d541fccc05 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Getting quotas for project 30033ce42b5a43b78dde38163831cea2. Resources: {'key_pairs'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:45:56.928285 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-5b9916dc-60db-4ef9-bb41-8589c9001617 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:56.933822 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-f152ca46-6009-4650-a1d7-09d541fccc05 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Getting quotas for user fd136fcda9a04a16b258301a86bde8ef and project 30033ce42b5a43b78dde38163831cea2. Resources: {'key_pairs'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:45:56.935705 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=100 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:56.936620 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5b9916dc-60db-4ef9-bb41-8589c9001617 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:56.937314 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5b9916dc-60db-4ef9-bb41-8589c9001617 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:56.938272 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5b9916dc-60db-4ef9-bb41-8589c9001617 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:56.938935 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5b9916dc-60db-4ef9-bb41-8589c9001617 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:56.959063 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f152ca46-6009-4650-a1d7-09d541fccc05 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052860 Jun 24 09:45:56.959682 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 287/552] 10.222.0.65 () {60 vars in 1158 bytes} [Fri Jun 24 09:45:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:45:57.036509 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f12303ec-b721-4671-a42d-cbd179c4e925 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:57.037128 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-f12303ec-b721-4671-a42d-cbd179c4e925 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:57.050318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f12303ec-b721-4671-a42d-cbd179c4e925 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:57.050947 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f12303ec-b721-4671-a42d-cbd179c4e925 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:57.051897 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f12303ec-b721-4671-a42d-cbd179c4e925 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:57.052485 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f12303ec-b721-4671-a42d-cbd179c4e925 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:57.146408 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-5b9916dc-60db-4ef9-bb41-8589c9001617 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:57.157139 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-5b9916dc-60db-4ef9-bb41-8589c9001617 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.235904 Jun 24 09:45:57.157730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 266/553] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:56 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:45:57.209103 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-f12303ec-b721-4671-a42d-cbd179c4e925 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3283218fb79487491de597fdfc16916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e1bb5bd1741ae98304f809dea24f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:57.212596 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:57.218702 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f12303ec-b721-4671-a42d-cbd179c4e925 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 200 len: 1470 microversion: 2.1 time: 0.186151 Jun 24 09:45:57.219463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 288/554] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:57 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 1470 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:45:58.175681 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-c0a72adf-5eb1-4347-9bff-10d38700fdfa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:58.176297 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-c0a72adf-5eb1-4347-9bff-10d38700fdfa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:58.184962 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c0a72adf-5eb1-4347-9bff-10d38700fdfa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:58.185597 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c0a72adf-5eb1-4347-9bff-10d38700fdfa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:58.186456 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c0a72adf-5eb1-4347-9bff-10d38700fdfa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:58.186895 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c0a72adf-5eb1-4347-9bff-10d38700fdfa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:58.237197 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-fe4acfe9-f167-4a80-9d2b-e27804eadccf tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:58.237821 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-fe4acfe9-f167-4a80-9d2b-e27804eadccf tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:58.257060 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fe4acfe9-f167-4a80-9d2b-e27804eadccf tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:58.259608 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fe4acfe9-f167-4a80-9d2b-e27804eadccf tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:58.260692 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fe4acfe9-f167-4a80-9d2b-e27804eadccf tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:58.264528 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fe4acfe9-f167-4a80-9d2b-e27804eadccf tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:58.573297 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-c0a72adf-5eb1-4347-9bff-10d38700fdfa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:58.581531 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-c0a72adf-5eb1-4347-9bff-10d38700fdfa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.409741 Jun 24 09:45:58.582122 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 267/555] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:58 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:58.587284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-754a3bbb-a66e-4270-a155-aac9a7adba17 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-232313078", "imageRef": "844ad823-18a2-4abc-813c-2d1825141591", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6d825bf-3025-4144-aa4c-5693ec78fffa"}], "security_groups": [{"name": "tempest-securitygroup--2041192471"}], "key_name": "tempest-keypair-1439492096", "user_data": "}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:58.593552 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-fe4acfe9-f167-4a80-9d2b-e27804eadccf tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3283218fb79487491de597fdfc16916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e1bb5bd1741ae98304f809dea24f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:58.604074 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-fe4acfe9-f167-4a80-9d2b-e27804eadccf tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 200 len: 1470 microversion: 2.1 time: 0.371176 Jun 24 09:45:58.614488 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 289/556] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:58 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 1470 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:45:58.731874 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.network.neutron [None req-754a3bbb-a66e-4270-a155-aac9a7adba17 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] validate_networks() for [('d6d825bf-3025-4144-aa4c-5693ec78fffa', None, None, None, None, None)] {{(pid=124338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:45:58.936848 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-97d19d0b-be22-4852-a042-304ab5972f71 req-bc20009a-40ff-4b8c-8079-0b3816238876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d", "name": "network-vif-deleted", "tag": "8bb30a85-c910-4956-a948-de9e8499b925"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:45:58.946531 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-97d19d0b-be22-4852-a042-304ab5972f71 req-bc20009a-40ff-4b8c-8079-0b3816238876 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:58.947333 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-97d19d0b-be22-4852-a042-304ab5972f71 req-bc20009a-40ff-4b8c-8079-0b3816238876 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:58.962778 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-97d19d0b-be22-4852-a042-304ab5972f71 req-bc20009a-40ff-4b8c-8079-0b3816238876 service nova] Creating event network-vif-deleted:8bb30a85-c910-4956-a948-de9e8499b925 for instance 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d on hv-cinder-80382 Jun 24 09:45:58.969669 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-97d19d0b-be22-4852-a042-304ab5972f71 req-bc20009a-40ff-4b8c-8079-0b3816238876 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036771 Jun 24 09:45:58.970870 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 290/557] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:45:59.216476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-754a3bbb-a66e-4270-a155-aac9a7adba17 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Flavor limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:45:59.217102 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-754a3bbb-a66e-4270-a155-aac9a7adba17 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Image limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:45:59.217646 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-754a3bbb-a66e-4270-a155-aac9a7adba17 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Flavor pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:45:59.218109 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-754a3bbb-a66e-4270-a155-aac9a7adba17 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Image pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:45:59.218524 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-754a3bbb-a66e-4270-a155-aac9a7adba17 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:45:59.228143 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-754a3bbb-a66e-4270-a155-aac9a7adba17 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:59.228587 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-754a3bbb-a66e-4270-a155-aac9a7adba17 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:59.229381 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-754a3bbb-a66e-4270-a155-aac9a7adba17 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:59.229814 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-754a3bbb-a66e-4270-a155-aac9a7adba17 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:59.247458 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-754a3bbb-a66e-4270-a155-aac9a7adba17 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Getting quotas for project 30033ce42b5a43b78dde38163831cea2. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:45:59.251848 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-754a3bbb-a66e-4270-a155-aac9a7adba17 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Getting quotas for user fd136fcda9a04a16b258301a86bde8ef and project 30033ce42b5a43b78dde38163831cea2. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:45:59.264106 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-754a3bbb-a66e-4270-a155-aac9a7adba17 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Going to run 1 instances... {{(pid=124338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:45:59.266407 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-754a3bbb-a66e-4270-a155-aac9a7adba17 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='844ad823-18a2-4abc-813c-2d1825141591',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:45:59.313873 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c74da83a-09f6-40c1-9cf5-2f58c367ec35 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:59.315991 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-c74da83a-09f6-40c1-9cf5-2f58c367ec35 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:59.320929 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-754a3bbb-a66e-4270-a155-aac9a7adba17 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.737206 Jun 24 09:45:59.326682 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c74da83a-09f6-40c1-9cf5-2f58c367ec35 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:59.327502 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 268/558] 10.222.0.65 () {60 vars in 1146 bytes} [Fri Jun 24 09:45:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 09:45:59.328419 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c74da83a-09f6-40c1-9cf5-2f58c367ec35 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:59.330239 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c74da83a-09f6-40c1-9cf5-2f58c367ec35 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:59.331614 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c74da83a-09f6-40c1-9cf5-2f58c367ec35 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:59.332929 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-3626dae1-824b-4e2d-a7dc-78c58659470f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:59.333806 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-3626dae1-824b-4e2d-a7dc-78c58659470f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:59.413579 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-3626dae1-824b-4e2d-a7dc-78c58659470f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:59.421389 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-3626dae1-824b-4e2d-a7dc-78c58659470f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3" status: 200 len: 1241 microversion: 2.1 time: 0.092400 Jun 24 09:45:59.422142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 269/559] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:59 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:45:59.535728 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c74da83a-09f6-40c1-9cf5-2f58c367ec35 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:59.544329 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-c74da83a-09f6-40c1-9cf5-2f58c367ec35 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1594 microversion: 2.1 time: 0.239072 Jun 24 09:45:59.544926 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 291/560] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:59 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1594 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:45:59.598728 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-26fd2207-77cf-49d4-9e32-ae9fee08605a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:59.599412 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-26fd2207-77cf-49d4-9e32-ae9fee08605a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:59.605914 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-26fd2207-77cf-49d4-9e32-ae9fee08605a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:59.606366 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-26fd2207-77cf-49d4-9e32-ae9fee08605a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:59.607711 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-26fd2207-77cf-49d4-9e32-ae9fee08605a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:59.608137 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-26fd2207-77cf-49d4-9e32-ae9fee08605a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:59.626046 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c158da0d-d19c-4853-a6c2-6a5672a80ed6 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:45:59.626668 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-c158da0d-d19c-4853-a6c2-6a5672a80ed6 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] [instance: 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:45:59.646076 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c158da0d-d19c-4853-a6c2-6a5672a80ed6 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:59.646533 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c158da0d-d19c-4853-a6c2-6a5672a80ed6 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:59.647382 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c158da0d-d19c-4853-a6c2-6a5672a80ed6 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:45:59.647942 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c158da0d-d19c-4853-a6c2-6a5672a80ed6 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:45:59.664405 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-c158da0d-d19c-4853-a6c2-6a5672a80ed6 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] HTTP exception thrown: Instance 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d could not be found. Jun 24 09:45:59.666101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c158da0d-d19c-4853-a6c2-6a5672a80ed6 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Request method failure captured: Jun 24 09:45:59.666101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d HTTP/1.1 Jun 24 09:45:59.666101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:45:59.666101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:45:59.666101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:45:59.666101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:45:59.666101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:45:59.666101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:45:59.666101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:45:59.666101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:45:59.666101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYe7Z_ziZ1QDRnlVIe_EW1SERUhC08A_oaPPZ6Emtj_xXEwAwblecTZ3AM3t-vzZaPl1Ra1tJYz3j-2FHG2Pr7D4adx7z-j8tw5SUPSdqHO_GxHT9kcKzK_DfKd_XHaGZAkCkvBf1WgvmnWEdaTzT8tPdNwmio8v1k_ysGHrIirGH60 Jun 24 09:45:59.666101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:45:59.666101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:45:59.666101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:45:59.666101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:45:59.666101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:45:59.666101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:45:59.666101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: c15e1bb5bd1741ae98304f809dea24f7 Jun 24 09:45:59.666101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-VolumesNegativeTest-439698541 Jun 24 09:45:59.666101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:45:59.666101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:45:59.667660 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c15e1bb5bd1741ae98304f809dea24f7", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c15e1bb5bd1741ae98304f809dea24f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c15e1bb5bd1741ae98304f809dea24f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c15e1bb5bd1741ae98304f809dea24f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:45:59.667660 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-VolumesNegativeTest-439698541 Jun 24 09:45:59.667660 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: c15e1bb5bd1741ae98304f809dea24f7 Jun 24 09:45:59.667660 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-VolumesNegativeTest-439698541 Jun 24 09:45:59.667660 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-VolumesNegativeTest-439698541-project Jun 24 09:45:59.667660 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:45:59.667660 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:45:59.667660 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: a3283218fb79487491de597fdfc16916 Jun 24 09:45:59.667660 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-VolumesNegativeTest-439698541-project Jun 24 09:45:59.667660 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:45:59.667660 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d could not be found. Jun 24 09:45:59.667660 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': '4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d'} Jun 24 09:45:59.668549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:45:59.668549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:45:59.668549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:45:59.668549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:45:59.668549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:45:59.668549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:45:59.668549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:45:59.668549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:45:59.668549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:45:59.668549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:45:59.668549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d could not be found. Jun 24 09:45:59.668549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:45:59.668549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:45:59.668549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:45:59.668549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:45:59.668549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:45:59.668549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:45:59.668549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:45:59.668549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:45:59.668549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:45:59.670025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:45:59.670025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:45:59.670025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:45:59.670025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:45:59.670025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:45:59.670025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:45:59.670025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:45:59.670025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d could not be found. Jun 24 09:45:59.670025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:45:59.670025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:45:59.670025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:45:59.670025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:45:59.670025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:45:59.670025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:45:59.670025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:45:59.670025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:45:59.670025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d could not be found. Jun 24 09:45:59.670025 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:45:59.671348 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c158da0d-d19c-4853-a6c2-6a5672a80ed6 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] Returning 404 to user: Instance 4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:45:59.671348 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-c158da0d-d19c-4853-a6c2-6a5672a80ed6 tempest-VolumesNegativeTest-439698541 tempest-VolumesNegativeTest-439698541-project] 10.222.0.65 "GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d" status: 404 len: 111 microversion: 2.1 time: 0.045415 Jun 24 09:45:59.688789 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 292/561] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:59 2022] GET /compute/v2.1/servers/4c1fd2d9-b83a-4f0b-9bcc-90ae0e0add3d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:45:59.793597 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-26fd2207-77cf-49d4-9e32-ae9fee08605a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:45:59.805650 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-26fd2207-77cf-49d4-9e32-ae9fee08605a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.211677 Jun 24 09:45:59.806736 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 270/562] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:45:59 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:00.439247 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-ba732812-9dd8-4bbf-89bf-5b65e087545e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:00.439868 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-ba732812-9dd8-4bbf-89bf-5b65e087545e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:00.450678 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ba732812-9dd8-4bbf-89bf-5b65e087545e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:00.451156 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ba732812-9dd8-4bbf-89bf-5b65e087545e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:00.452103 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ba732812-9dd8-4bbf-89bf-5b65e087545e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:00.452553 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ba732812-9dd8-4bbf-89bf-5b65e087545e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:00.546709 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ba732812-9dd8-4bbf-89bf-5b65e087545e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:00.560708 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-ba732812-9dd8-4bbf-89bf-5b65e087545e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3" status: 200 len: 1293 microversion: 2.1 time: 0.125267 Jun 24 09:46:00.572130 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 293/563] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:00 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 => generated 1293 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:00.824724 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-706eca63-3834-4c48-8cc9-e0f627fc8ad4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:00.826089 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-706eca63-3834-4c48-8cc9-e0f627fc8ad4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:00.835332 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-706eca63-3834-4c48-8cc9-e0f627fc8ad4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:00.836010 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-706eca63-3834-4c48-8cc9-e0f627fc8ad4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:00.837090 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-706eca63-3834-4c48-8cc9-e0f627fc8ad4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:00.837803 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-706eca63-3834-4c48-8cc9-e0f627fc8ad4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:01.085617 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-706eca63-3834-4c48-8cc9-e0f627fc8ad4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:01.095606 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-706eca63-3834-4c48-8cc9-e0f627fc8ad4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.276096 Jun 24 09:46:01.096653 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 271/564] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:00 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:01.579095 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f848b609-123f-4aa7-a18e-b922b6d9567e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:01.580398 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-f848b609-123f-4aa7-a18e-b922b6d9567e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:01.601466 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f848b609-123f-4aa7-a18e-b922b6d9567e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:01.602451 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f848b609-123f-4aa7-a18e-b922b6d9567e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:01.603940 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f848b609-123f-4aa7-a18e-b922b6d9567e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:01.604591 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f848b609-123f-4aa7-a18e-b922b6d9567e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:01.785922 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-ad87a258-6373-47ba-b7ea-ad77931d0ef3 req-64af4dbd-01ca-4050-a416-71fbc8d4c5ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d874254-475b-4025-8b67-b4af897fdb60", "tag": "de309464-eb94-4c38-b29b-c293a12d68b1"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:46:01.802381 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-ad87a258-6373-47ba-b7ea-ad77931d0ef3 req-64af4dbd-01ca-4050-a416-71fbc8d4c5ca service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:01.802839 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-ad87a258-6373-47ba-b7ea-ad77931d0ef3 req-64af4dbd-01ca-4050-a416-71fbc8d4c5ca service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:01.864224 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-ad87a258-6373-47ba-b7ea-ad77931d0ef3 req-64af4dbd-01ca-4050-a416-71fbc8d4c5ca service nova] Creating event network-changed:de309464-eb94-4c38-b29b-c293a12d68b1 for instance 0d874254-475b-4025-8b67-b4af897fdb60 on hv-cinder-80382 Jun 24 09:46:01.874496 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-ad87a258-6373-47ba-b7ea-ad77931d0ef3 req-64af4dbd-01ca-4050-a416-71fbc8d4c5ca service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090778 Jun 24 09:46:01.876394 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 272/565] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:46:02.100817 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-f848b609-123f-4aa7-a18e-b922b6d9567e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:02.114362 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-241cb124-b265-4980-a4ca-f2e430dfbf0f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:02.115252 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-241cb124-b265-4980-a4ca-f2e430dfbf0f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:02.115920 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f848b609-123f-4aa7-a18e-b922b6d9567e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3" status: 200 len: 1367 microversion: 2.1 time: 0.540354 Jun 24 09:46:02.118205 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 294/566] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:01 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 => generated 1367 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:02.124752 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-241cb124-b265-4980-a4ca-f2e430dfbf0f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:02.126004 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-241cb124-b265-4980-a4ca-f2e430dfbf0f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:02.126900 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-241cb124-b265-4980-a4ca-f2e430dfbf0f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:02.127426 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-241cb124-b265-4980-a4ca-f2e430dfbf0f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:02.714734 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-241cb124-b265-4980-a4ca-f2e430dfbf0f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:02.735985 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-241cb124-b265-4980-a4ca-f2e430dfbf0f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.621365 Jun 24 09:46:02.739679 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 273/567] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:02 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:03.134397 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-39801dd7-8dda-486b-95e2-4afd52b91a45 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:03.135444 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-39801dd7-8dda-486b-95e2-4afd52b91a45 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:03.142633 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-39801dd7-8dda-486b-95e2-4afd52b91a45 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:03.143615 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-39801dd7-8dda-486b-95e2-4afd52b91a45 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:03.144566 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-39801dd7-8dda-486b-95e2-4afd52b91a45 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:03.145556 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-39801dd7-8dda-486b-95e2-4afd52b91a45 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:03.328024 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-c54ba09e-fad6-4322-9df6-a806bf202f9c req-c0df0860-cc6a-47f4-ae0d-ca87df237d5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e892f2df-f3bb-4a2d-8152-4bc170cff4b3", "tag": "74e14930-4c89-4d5f-9bea-32720c272816"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:46:03.345887 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-c54ba09e-fad6-4322-9df6-a806bf202f9c req-c0df0860-cc6a-47f4-ae0d-ca87df237d5b service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:03.346904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-c54ba09e-fad6-4322-9df6-a806bf202f9c req-c0df0860-cc6a-47f4-ae0d-ca87df237d5b service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:03.363776 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-c54ba09e-fad6-4322-9df6-a806bf202f9c req-c0df0860-cc6a-47f4-ae0d-ca87df237d5b service nova] Creating event network-changed:74e14930-4c89-4d5f-9bea-32720c272816 for instance e892f2df-f3bb-4a2d-8152-4bc170cff4b3 on hv-cinder-80382 Jun 24 09:46:03.375507 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-c54ba09e-fad6-4322-9df6-a806bf202f9c req-c0df0860-cc6a-47f4-ae0d-ca87df237d5b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058476 Jun 24 09:46:03.376480 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 274/568] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:46:03.553669 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-39801dd7-8dda-486b-95e2-4afd52b91a45 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:03.564823 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-39801dd7-8dda-486b-95e2-4afd52b91a45 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3" status: 200 len: 1367 microversion: 2.1 time: 0.434821 Jun 24 09:46:03.566285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 295/569] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:03 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 => generated 1367 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:03.752646 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7a7de8e4-8f52-44c2-a636-1f356038d5c9 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:03.753649 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-7a7de8e4-8f52-44c2-a636-1f356038d5c9 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:03.761039 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7a7de8e4-8f52-44c2-a636-1f356038d5c9 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:03.762147 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7a7de8e4-8f52-44c2-a636-1f356038d5c9 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:03.763568 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7a7de8e4-8f52-44c2-a636-1f356038d5c9 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:03.764152 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7a7de8e4-8f52-44c2-a636-1f356038d5c9 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:03.920742 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-716687f6-336f-4915-8ab3-9beae5c5625a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2007842856"}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:46:03.921300 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-716687f6-336f-4915-8ab3-9beae5c5625a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:03.929202 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-716687f6-336f-4915-8ab3-9beae5c5625a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:03.929665 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-716687f6-336f-4915-8ab3-9beae5c5625a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:03.930445 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-716687f6-336f-4915-8ab3-9beae5c5625a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:03.930881 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-716687f6-336f-4915-8ab3-9beae5c5625a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:03.978659 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-7a7de8e4-8f52-44c2-a636-1f356038d5c9 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:03.987153 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-7a7de8e4-8f52-44c2-a636-1f356038d5c9 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.241784 Jun 24 09:46:03.987757 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 275/570] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:03 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:04.076255 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.network.security_group_api [None req-716687f6-336f-4915-8ab3-9beae5c5625a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Adding security group 309ce118-b51a-42e5-b315-1f2652eb254c to port de309464-eb94-4c38-b29b-c293a12d68b1 Jun 24 09:46:04.526237 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-716687f6-336f-4915-8ab3-9beae5c5625a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "POST /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/action" status: 202 len: 0 microversion: 2.1 time: 0.609485 Jun 24 09:46:04.527149 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 296/571] 10.222.0.65 () {60 vars in 1277 bytes} [Fri Jun 24 09:46:03 2022] POST /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 09:46:04.537199 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-d9d6ce8a-c71a-41dc-ba93-b788707a460a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:04.537930 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-d9d6ce8a-c71a-41dc-ba93-b788707a460a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:04.548776 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d9d6ce8a-c71a-41dc-ba93-b788707a460a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:04.549266 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d9d6ce8a-c71a-41dc-ba93-b788707a460a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:04.550079 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d9d6ce8a-c71a-41dc-ba93-b788707a460a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:04.550512 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d9d6ce8a-c71a-41dc-ba93-b788707a460a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:04.581917 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1f7734f1-43ea-4aeb-a288-2e1c27f97a67 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:04.582911 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-1f7734f1-43ea-4aeb-a288-2e1c27f97a67 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:04.595262 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1f7734f1-43ea-4aeb-a288-2e1c27f97a67 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:04.597917 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1f7734f1-43ea-4aeb-a288-2e1c27f97a67 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:04.600016 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1f7734f1-43ea-4aeb-a288-2e1c27f97a67 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:04.601093 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1f7734f1-43ea-4aeb-a288-2e1c27f97a67 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:04.865277 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d9d6ce8a-c71a-41dc-ba93-b788707a460a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:04.875375 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-d9d6ce8a-c71a-41dc-ba93-b788707a460a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1759 microversion: 2.1 time: 0.342522 Jun 24 09:46:04.876664 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 276/572] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:04 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1759 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:04.891606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-1f7734f1-43ea-4aeb-a288-2e1c27f97a67 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:04.899965 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-1f7734f1-43ea-4aeb-a288-2e1c27f97a67 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3" status: 200 len: 1367 microversion: 2.1 time: 0.321867 Jun 24 09:46:04.900835 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 297/573] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:04 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:46:05.004279 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-0bd374fe-abca-456b-88cd-36c9842d72b6 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:05.005179 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-0bd374fe-abca-456b-88cd-36c9842d72b6 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:05.012508 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0bd374fe-abca-456b-88cd-36c9842d72b6 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:05.013527 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0bd374fe-abca-456b-88cd-36c9842d72b6 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:05.014516 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0bd374fe-abca-456b-88cd-36c9842d72b6 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:05.015188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0bd374fe-abca-456b-88cd-36c9842d72b6 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:05.177075 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-0bd374fe-abca-456b-88cd-36c9842d72b6 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:05.186948 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-0bd374fe-abca-456b-88cd-36c9842d72b6 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.186817 Jun 24 09:46:05.197356 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 277/574] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:04 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:05.410428 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-8d924cb4-2ed1-48ea-8f2a-cbe2d10ec2d9 req-400bd2ab-9b19-46b7-872f-f0e4033c01ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d874254-475b-4025-8b67-b4af897fdb60", "tag": "de309464-eb94-4c38-b29b-c293a12d68b1"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:46:05.419761 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-8d924cb4-2ed1-48ea-8f2a-cbe2d10ec2d9 req-400bd2ab-9b19-46b7-872f-f0e4033c01ff service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:05.420741 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-8d924cb4-2ed1-48ea-8f2a-cbe2d10ec2d9 req-400bd2ab-9b19-46b7-872f-f0e4033c01ff service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:05.432460 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-8d924cb4-2ed1-48ea-8f2a-cbe2d10ec2d9 req-400bd2ab-9b19-46b7-872f-f0e4033c01ff service nova] Creating event network-changed:de309464-eb94-4c38-b29b-c293a12d68b1 for instance 0d874254-475b-4025-8b67-b4af897fdb60 on hv-cinder-80382 Jun 24 09:46:05.437582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-8d924cb4-2ed1-48ea-8f2a-cbe2d10ec2d9 req-400bd2ab-9b19-46b7-872f-f0e4033c01ff service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031149 Jun 24 09:46:05.438237 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 298/575] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:46:05.918019 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ec081c4a-0f12-4ef7-adfb-d3b40385c993 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:05.918632 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ec081c4a-0f12-4ef7-adfb-d3b40385c993 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:05.929921 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ec081c4a-0f12-4ef7-adfb-d3b40385c993 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:05.931371 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ec081c4a-0f12-4ef7-adfb-d3b40385c993 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:05.932451 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ec081c4a-0f12-4ef7-adfb-d3b40385c993 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:05.936137 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ec081c4a-0f12-4ef7-adfb-d3b40385c993 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:06.159928 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ec081c4a-0f12-4ef7-adfb-d3b40385c993 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:06.167768 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ec081c4a-0f12-4ef7-adfb-d3b40385c993 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3" status: 200 len: 1367 microversion: 2.1 time: 0.253809 Jun 24 09:46:06.168298 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 278/576] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:05 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:06.205528 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-af0a0212-3772-4de8-943f-183c87c7a45d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:06.206353 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-af0a0212-3772-4de8-943f-183c87c7a45d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:06.213134 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-af0a0212-3772-4de8-943f-183c87c7a45d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:06.213580 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-af0a0212-3772-4de8-943f-183c87c7a45d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:06.214408 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-af0a0212-3772-4de8-943f-183c87c7a45d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:06.214840 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-af0a0212-3772-4de8-943f-183c87c7a45d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:06.421770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-af0a0212-3772-4de8-943f-183c87c7a45d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:06.430428 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-af0a0212-3772-4de8-943f-183c87c7a45d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.229198 Jun 24 09:46:06.431249 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 299/577] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:06 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:07.184906 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-3f0f3fb8-f69f-4254-8015-a88c6e4ceb93 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:07.186104 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-3f0f3fb8-f69f-4254-8015-a88c6e4ceb93 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:07.193130 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3f0f3fb8-f69f-4254-8015-a88c6e4ceb93 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:07.193572 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3f0f3fb8-f69f-4254-8015-a88c6e4ceb93 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:07.194361 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3f0f3fb8-f69f-4254-8015-a88c6e4ceb93 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:07.194791 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3f0f3fb8-f69f-4254-8015-a88c6e4ceb93 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:07.328227 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-3f0f3fb8-f69f-4254-8015-a88c6e4ceb93 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:07.336183 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-3f0f3fb8-f69f-4254-8015-a88c6e4ceb93 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3" status: 200 len: 1367 microversion: 2.1 time: 0.155300 Jun 24 09:46:07.336785 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 279/578] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:07 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:07.448753 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4291bb28-8aea-40d7-b2dc-97e87904498c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:07.449326 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-4291bb28-8aea-40d7-b2dc-97e87904498c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:07.451913 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=4 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:07.458344 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4291bb28-8aea-40d7-b2dc-97e87904498c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:07.458789 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4291bb28-8aea-40d7-b2dc-97e87904498c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:07.459616 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4291bb28-8aea-40d7-b2dc-97e87904498c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:07.460050 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4291bb28-8aea-40d7-b2dc-97e87904498c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:07.602406 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4291bb28-8aea-40d7-b2dc-97e87904498c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:07.615733 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-4291bb28-8aea-40d7-b2dc-97e87904498c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.170415 Jun 24 09:46:07.616682 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 300/579] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:07 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:08.353818 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-20abeedb-ad7a-45eb-9539-fb829d3c3733 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:08.354366 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-20abeedb-ad7a-45eb-9539-fb829d3c3733 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:08.361266 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-20abeedb-ad7a-45eb-9539-fb829d3c3733 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:08.361719 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-20abeedb-ad7a-45eb-9539-fb829d3c3733 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:08.362486 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-20abeedb-ad7a-45eb-9539-fb829d3c3733 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:08.362896 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-20abeedb-ad7a-45eb-9539-fb829d3c3733 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:08.519661 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-20abeedb-ad7a-45eb-9539-fb829d3c3733 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:08.527618 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-20abeedb-ad7a-45eb-9539-fb829d3c3733 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3" status: 200 len: 1367 microversion: 2.1 time: 0.178343 Jun 24 09:46:08.528184 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 280/580] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:08 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:08.635753 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3062ee48-a1c2-4aef-b0bb-0b8c78eef7e2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:08.636283 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3062ee48-a1c2-4aef-b0bb-0b8c78eef7e2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:08.643730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3062ee48-a1c2-4aef-b0bb-0b8c78eef7e2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:08.644173 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3062ee48-a1c2-4aef-b0bb-0b8c78eef7e2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:08.644935 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3062ee48-a1c2-4aef-b0bb-0b8c78eef7e2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:08.645357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3062ee48-a1c2-4aef-b0bb-0b8c78eef7e2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:08.780729 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3062ee48-a1c2-4aef-b0bb-0b8c78eef7e2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:08.788878 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3062ee48-a1c2-4aef-b0bb-0b8c78eef7e2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.157981 Jun 24 09:46:08.789474 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 301/581] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:08 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:46:09.549602 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7c98cfb0-8f90-4855-b2b0-5507dccbbf0a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:09.550223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-7c98cfb0-8f90-4855-b2b0-5507dccbbf0a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:09.552241 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=2 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:09.553412 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=8 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:09.559645 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7c98cfb0-8f90-4855-b2b0-5507dccbbf0a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:09.560098 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7c98cfb0-8f90-4855-b2b0-5507dccbbf0a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:09.560894 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7c98cfb0-8f90-4855-b2b0-5507dccbbf0a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:09.561331 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7c98cfb0-8f90-4855-b2b0-5507dccbbf0a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:09.703502 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-7c98cfb0-8f90-4855-b2b0-5507dccbbf0a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:09.711457 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-7c98cfb0-8f90-4855-b2b0-5507dccbbf0a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3" status: 200 len: 1367 microversion: 2.1 time: 0.167200 Jun 24 09:46:09.712044 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 281/582] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:09 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:09.806847 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-40e956fe-9a23-49dc-8a8b-a5a9993684fb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:09.807585 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-40e956fe-9a23-49dc-8a8b-a5a9993684fb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:09.815271 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-40e956fe-9a23-49dc-8a8b-a5a9993684fb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:09.815725 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-40e956fe-9a23-49dc-8a8b-a5a9993684fb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:09.816514 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-40e956fe-9a23-49dc-8a8b-a5a9993684fb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:09.816950 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-40e956fe-9a23-49dc-8a8b-a5a9993684fb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:09.957796 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-40e956fe-9a23-49dc-8a8b-a5a9993684fb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:09.968990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-40e956fe-9a23-49dc-8a8b-a5a9993684fb tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.165966 Jun 24 09:46:09.969920 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 302/583] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:09 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:10.730850 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-33f0efbd-d4b1-473e-9635-39a7b805a5ab tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:10.736032 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-4124fae1-1e2d-49ff-826a-fac6764a9fc0 req-c879044e-6d7e-40d4-836b-06017912fb0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e892f2df-f3bb-4a2d-8152-4bc170cff4b3", "name": "network-vif-plugged", "status": "completed", "tag": "74e14930-4c89-4d5f-9bea-32720c272816"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:46:10.739662 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-33f0efbd-d4b1-473e-9635-39a7b805a5ab tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:10.751109 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-4124fae1-1e2d-49ff-826a-fac6764a9fc0 req-c879044e-6d7e-40d4-836b-06017912fb0a service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:10.754623 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-33f0efbd-d4b1-473e-9635-39a7b805a5ab tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:10.755066 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-33f0efbd-d4b1-473e-9635-39a7b805a5ab tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:10.755855 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-33f0efbd-d4b1-473e-9635-39a7b805a5ab tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:10.756291 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-33f0efbd-d4b1-473e-9635-39a7b805a5ab tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:10.761000 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-4124fae1-1e2d-49ff-826a-fac6764a9fc0 req-c879044e-6d7e-40d4-836b-06017912fb0a service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:10.782082 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-4124fae1-1e2d-49ff-826a-fac6764a9fc0 req-c879044e-6d7e-40d4-836b-06017912fb0a service nova] Creating event network-vif-plugged:74e14930-4c89-4d5f-9bea-32720c272816 for instance e892f2df-f3bb-4a2d-8152-4bc170cff4b3 on hv-cinder-80382 Jun 24 09:46:10.788572 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-4124fae1-1e2d-49ff-826a-fac6764a9fc0 req-c879044e-6d7e-40d4-836b-06017912fb0a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055927 Jun 24 09:46:10.789314 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 303/584] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:46:10.907396 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-33f0efbd-d4b1-473e-9635-39a7b805a5ab tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:10.915246 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-33f0efbd-d4b1-473e-9635-39a7b805a5ab tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3" status: 200 len: 1367 microversion: 2.1 time: 0.188289 Jun 24 09:46:10.915786 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 282/585] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:10 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:10.988516 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-fec5214a-a698-470e-be09-77f841b321e7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:10.989253 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-fec5214a-a698-470e-be09-77f841b321e7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:10.996585 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fec5214a-a698-470e-be09-77f841b321e7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:10.997017 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fec5214a-a698-470e-be09-77f841b321e7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:10.997781 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fec5214a-a698-470e-be09-77f841b321e7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:10.998213 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fec5214a-a698-470e-be09-77f841b321e7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:11.136968 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-fec5214a-a698-470e-be09-77f841b321e7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:11.145545 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-fec5214a-a698-470e-be09-77f841b321e7 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.161969 Jun 24 09:46:11.146120 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 304/586] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:10 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:11.934918 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-324b7824-1066-417e-b8a1-a76c9caba199 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:11.935709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-324b7824-1066-417e-b8a1-a76c9caba199 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:11.943964 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-324b7824-1066-417e-b8a1-a76c9caba199 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:11.944416 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-324b7824-1066-417e-b8a1-a76c9caba199 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:11.945173 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-324b7824-1066-417e-b8a1-a76c9caba199 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:11.945594 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-324b7824-1066-417e-b8a1-a76c9caba199 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:12.082159 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-324b7824-1066-417e-b8a1-a76c9caba199 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:12.093361 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-324b7824-1066-417e-b8a1-a76c9caba199 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3" status: 200 len: 1367 microversion: 2.1 time: 0.163769 Jun 24 09:46:12.094074 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 283/587] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:11 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:12.166695 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-9b3d39e8-60d6-4c88-94d8-d09470561329 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:12.167611 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-9b3d39e8-60d6-4c88-94d8-d09470561329 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:12.177696 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9b3d39e8-60d6-4c88-94d8-d09470561329 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:12.178391 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9b3d39e8-60d6-4c88-94d8-d09470561329 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:12.179701 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9b3d39e8-60d6-4c88-94d8-d09470561329 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:12.180330 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9b3d39e8-60d6-4c88-94d8-d09470561329 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:12.321339 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-9b3d39e8-60d6-4c88-94d8-d09470561329 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:12.333096 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-9b3d39e8-60d6-4c88-94d8-d09470561329 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.172592 Jun 24 09:46:12.333669 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 305/588] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:12 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:13.112988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ad00b20d-c528-4f6d-a005-0e576e5d692c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:13.113717 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ad00b20d-c528-4f6d-a005-0e576e5d692c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:13.121645 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ad00b20d-c528-4f6d-a005-0e576e5d692c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:13.122168 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ad00b20d-c528-4f6d-a005-0e576e5d692c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:13.123060 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ad00b20d-c528-4f6d-a005-0e576e5d692c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:13.123638 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ad00b20d-c528-4f6d-a005-0e576e5d692c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:13.147733 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=100 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:13.272464 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ad00b20d-c528-4f6d-a005-0e576e5d692c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:13.280129 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ad00b20d-c528-4f6d-a005-0e576e5d692c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3" status: 200 len: 1367 microversion: 2.1 time: 0.172105 Jun 24 09:46:13.280729 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 284/589] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:13 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:13.351295 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3cb78386-af32-4b00-8714-e398dc5a0009 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:13.351940 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3cb78386-af32-4b00-8714-e398dc5a0009 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:13.358925 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3cb78386-af32-4b00-8714-e398dc5a0009 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:13.359407 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3cb78386-af32-4b00-8714-e398dc5a0009 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:13.360160 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3cb78386-af32-4b00-8714-e398dc5a0009 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:13.360581 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3cb78386-af32-4b00-8714-e398dc5a0009 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:13.497523 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3cb78386-af32-4b00-8714-e398dc5a0009 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:13.507805 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3cb78386-af32-4b00-8714-e398dc5a0009 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.161033 Jun 24 09:46:13.508393 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 306/590] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:13 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:14.297668 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-025e9242-56d7-413e-8dd0-8d315f0aa50c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:14.298267 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-025e9242-56d7-413e-8dd0-8d315f0aa50c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:14.305600 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-025e9242-56d7-413e-8dd0-8d315f0aa50c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:14.306045 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-025e9242-56d7-413e-8dd0-8d315f0aa50c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:14.306831 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-025e9242-56d7-413e-8dd0-8d315f0aa50c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:14.307303 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-025e9242-56d7-413e-8dd0-8d315f0aa50c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:14.451107 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-025e9242-56d7-413e-8dd0-8d315f0aa50c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:14.461373 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-025e9242-56d7-413e-8dd0-8d315f0aa50c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3" status: 200 len: 1367 microversion: 2.1 time: 0.167512 Jun 24 09:46:14.462173 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 285/591] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:14 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:14.525474 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-81aa430b-9b50-465f-8b36-63646d7d2ec3 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:14.525995 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-81aa430b-9b50-465f-8b36-63646d7d2ec3 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:14.533096 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-81aa430b-9b50-465f-8b36-63646d7d2ec3 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:14.533570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-81aa430b-9b50-465f-8b36-63646d7d2ec3 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:14.534334 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-81aa430b-9b50-465f-8b36-63646d7d2ec3 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:14.534764 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-81aa430b-9b50-465f-8b36-63646d7d2ec3 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:14.683986 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-81aa430b-9b50-465f-8b36-63646d7d2ec3 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:14.692915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-81aa430b-9b50-465f-8b36-63646d7d2ec3 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.171519 Jun 24 09:46:14.693494 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 307/592] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:14 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:15.478951 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-543fac93-11d1-412c-995c-57e1ffd7c217 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:15.479600 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-543fac93-11d1-412c-995c-57e1ffd7c217 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:15.486370 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-543fac93-11d1-412c-995c-57e1ffd7c217 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:15.487028 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-543fac93-11d1-412c-995c-57e1ffd7c217 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:15.488034 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-543fac93-11d1-412c-995c-57e1ffd7c217 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:15.488615 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-543fac93-11d1-412c-995c-57e1ffd7c217 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:15.639666 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-543fac93-11d1-412c-995c-57e1ffd7c217 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:15.647523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-543fac93-11d1-412c-995c-57e1ffd7c217 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3" status: 200 len: 1556 microversion: 2.1 time: 0.172606 Jun 24 09:46:15.648120 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 286/593] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:15 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:15.664891 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4eebb787-eb1f-4721-a80a-cab0c6564f75 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:15.665436 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-4eebb787-eb1f-4721-a80a-cab0c6564f75 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:15.672351 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4eebb787-eb1f-4721-a80a-cab0c6564f75 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:15.672803 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4eebb787-eb1f-4721-a80a-cab0c6564f75 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:15.673559 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4eebb787-eb1f-4721-a80a-cab0c6564f75 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:15.673995 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4eebb787-eb1f-4721-a80a-cab0c6564f75 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:15.692469 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=100 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:15.709890 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-b51ac848-5cdd-4c4e-b3db-2bc87425da0c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:15.710504 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-b51ac848-5cdd-4c4e-b3db-2bc87425da0c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:15.717272 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b51ac848-5cdd-4c4e-b3db-2bc87425da0c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:15.717784 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b51ac848-5cdd-4c4e-b3db-2bc87425da0c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:15.718648 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b51ac848-5cdd-4c4e-b3db-2bc87425da0c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:15.719086 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b51ac848-5cdd-4c4e-b3db-2bc87425da0c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:15.764514 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-4eebb787-eb1f-4721-a80a-cab0c6564f75 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103627 Jun 24 09:46:15.765297 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 308/594] 10.222.0.65 () {58 vars in 1274 bytes} [Fri Jun 24 09:46:15 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:46:15.864391 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-b51ac848-5cdd-4c4e-b3db-2bc87425da0c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:15.872588 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-b51ac848-5cdd-4c4e-b3db-2bc87425da0c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.167187 Jun 24 09:46:15.873176 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 287/595] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:15 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:46:16.735374 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-5aae2d2c-f384-4c4e-a464-4468fb924ee3 req-9fbc7df9-9657-4491-9075-4c36a1802ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e892f2df-f3bb-4a2d-8152-4bc170cff4b3", "tag": "74e14930-4c89-4d5f-9bea-32720c272816"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:46:16.749221 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-5aae2d2c-f384-4c4e-a464-4468fb924ee3 req-9fbc7df9-9657-4491-9075-4c36a1802ed0 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:16.749667 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-5aae2d2c-f384-4c4e-a464-4468fb924ee3 req-9fbc7df9-9657-4491-9075-4c36a1802ed0 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:16.761382 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-5aae2d2c-f384-4c4e-a464-4468fb924ee3 req-9fbc7df9-9657-4491-9075-4c36a1802ed0 service nova] Creating event network-changed:74e14930-4c89-4d5f-9bea-32720c272816 for instance e892f2df-f3bb-4a2d-8152-4bc170cff4b3 on hv-cinder-80382 Jun 24 09:46:16.767451 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-5aae2d2c-f384-4c4e-a464-4468fb924ee3 req-9fbc7df9-9657-4491-9075-4c36a1802ed0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036228 Jun 24 09:46:16.768359 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 309/596] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:46:16.890519 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-a58798db-ac52-4c41-b082-bc539329aada tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:16.891321 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-a58798db-ac52-4c41-b082-bc539329aada tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:16.893685 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:16.900919 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a58798db-ac52-4c41-b082-bc539329aada tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:16.901408 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a58798db-ac52-4c41-b082-bc539329aada tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:16.902183 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a58798db-ac52-4c41-b082-bc539329aada tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:16.902611 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a58798db-ac52-4c41-b082-bc539329aada tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:17.131645 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-a58798db-ac52-4c41-b082-bc539329aada tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:17.139899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-a58798db-ac52-4c41-b082-bc539329aada tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.253666 Jun 24 09:46:17.140482 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 288/597] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:16 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:18.163474 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f843f52f-69ff-4fb7-a830-92d60619ed9b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:18.164511 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-f843f52f-69ff-4fb7-a830-92d60619ed9b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:18.175703 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f843f52f-69ff-4fb7-a830-92d60619ed9b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:18.176675 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f843f52f-69ff-4fb7-a830-92d60619ed9b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:18.177358 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f843f52f-69ff-4fb7-a830-92d60619ed9b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:18.177811 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f843f52f-69ff-4fb7-a830-92d60619ed9b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:18.309519 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-f843f52f-69ff-4fb7-a830-92d60619ed9b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:18.317708 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f843f52f-69ff-4fb7-a830-92d60619ed9b tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.163037 Jun 24 09:46:18.318249 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 310/598] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:18 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:18.833263 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-e1b2298a-675e-42b0-8d7d-7060171c983a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:18.834057 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-e1b2298a-675e-42b0-8d7d-7060171c983a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:18.840863 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e1b2298a-675e-42b0-8d7d-7060171c983a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:18.841309 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e1b2298a-675e-42b0-8d7d-7060171c983a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:18.842065 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e1b2298a-675e-42b0-8d7d-7060171c983a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:18.842497 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e1b2298a-675e-42b0-8d7d-7060171c983a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:18.939604 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.objects.instance [None req-e1b2298a-675e-42b0-8d7d-7060171c983a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lazy-loading 'services' on Instance uuid a9395b1a-996b-49cf-93c7-44f262a92968 {{(pid=124338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:46:19.025263 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-e1b2298a-675e-42b0-8d7d-7060171c983a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968/os-volume_attachments/0aba3335-0764-4332-98f8-c35bfaf86356" status: 202 len: 0 microversion: 2.1 time: 0.195958 Jun 24 09:46:19.025863 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 289/599] 10.222.0.65 () {58 vars in 1415 bytes} [Fri Jun 24 09:46:18 2022] DELETE /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968/os-volume_attachments/0aba3335-0764-4332-98f8-c35bfaf86356 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:46:19.340070 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-ce476b09-68bf-4ebe-8eef-feda39c16485 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:19.340721 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-ce476b09-68bf-4ebe-8eef-feda39c16485 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:19.350335 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ce476b09-68bf-4ebe-8eef-feda39c16485 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:19.350789 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ce476b09-68bf-4ebe-8eef-feda39c16485 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:19.351604 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ce476b09-68bf-4ebe-8eef-feda39c16485 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:19.352032 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ce476b09-68bf-4ebe-8eef-feda39c16485 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:19.488470 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ce476b09-68bf-4ebe-8eef-feda39c16485 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:19.500861 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-ce476b09-68bf-4ebe-8eef-feda39c16485 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.164545 Jun 24 09:46:19.501593 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 311/600] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:19 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:20.524976 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-81c91c34-9852-4900-8009-5b528e2e2a53 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:20.525650 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-81c91c34-9852-4900-8009-5b528e2e2a53 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:20.532390 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-81c91c34-9852-4900-8009-5b528e2e2a53 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:20.532830 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-81c91c34-9852-4900-8009-5b528e2e2a53 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:20.533592 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-81c91c34-9852-4900-8009-5b528e2e2a53 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:20.534296 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-81c91c34-9852-4900-8009-5b528e2e2a53 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:20.674585 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-81c91c34-9852-4900-8009-5b528e2e2a53 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:20.682850 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-81c91c34-9852-4900-8009-5b528e2e2a53 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1734 microversion: 2.1 time: 0.164851 Jun 24 09:46:20.683436 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 290/601] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:20 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:21.208310 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-bc3feb05-ce22-4f8e-bf1d-4cad0559d4a1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:21.208901 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-bc3feb05-ce22-4f8e-bf1d-4cad0559d4a1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:21.215881 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bc3feb05-ce22-4f8e-bf1d-4cad0559d4a1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:21.216324 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bc3feb05-ce22-4f8e-bf1d-4cad0559d4a1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:21.217083 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bc3feb05-ce22-4f8e-bf1d-4cad0559d4a1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:21.217511 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bc3feb05-ce22-4f8e-bf1d-4cad0559d4a1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:21.245062 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-bc3feb05-ce22-4f8e-bf1d-4cad0559d4a1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Going to try to terminate instance {{(pid=124339) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:46:21.334732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-bc3feb05-ce22-4f8e-bf1d-4cad0559d4a1 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 204 len: 0 microversion: 2.1 time: 0.131498 Jun 24 09:46:21.335804 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 312/602] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:46:21 2022] DELETE /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:46:21.348298 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-65927993-88c3-47cf-bd41-29d15c1473fa tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:21.349447 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-65927993-88c3-47cf-bd41-29d15c1473fa tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:21.356274 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-65927993-88c3-47cf-bd41-29d15c1473fa tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:21.356721 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-65927993-88c3-47cf-bd41-29d15c1473fa tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:21.357484 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-65927993-88c3-47cf-bd41-29d15c1473fa tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:21.357913 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-65927993-88c3-47cf-bd41-29d15c1473fa tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:21.500328 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-65927993-88c3-47cf-bd41-29d15c1473fa tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:21.508312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-65927993-88c3-47cf-bd41-29d15c1473fa tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1514 microversion: 2.1 time: 0.165507 Jun 24 09:46:21.508891 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 291/603] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:21 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:21.707579 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-bfa04a49-1d69-4dbe-88d2-2249b14e42be tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:21.708202 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-bfa04a49-1d69-4dbe-88d2-2249b14e42be tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:21.714912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bfa04a49-1d69-4dbe-88d2-2249b14e42be tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:21.715400 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bfa04a49-1d69-4dbe-88d2-2249b14e42be tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:21.716193 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bfa04a49-1d69-4dbe-88d2-2249b14e42be tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:21.716627 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bfa04a49-1d69-4dbe-88d2-2249b14e42be tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:21.874306 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-bfa04a49-1d69-4dbe-88d2-2249b14e42be tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:21.886459 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-bfa04a49-1d69-4dbe-88d2-2249b14e42be tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1714 microversion: 2.1 time: 0.185089 Jun 24 09:46:21.890503 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 313/604] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:21 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1714 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:22.010601 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-c4ffdc37-a844-47cc-89d1-b8391b3dc4c5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:22.011240 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-c4ffdc37-a844-47cc-89d1-b8391b3dc4c5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:22.018505 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c4ffdc37-a844-47cc-89d1-b8391b3dc4c5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:22.018959 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c4ffdc37-a844-47cc-89d1-b8391b3dc4c5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:22.019764 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c4ffdc37-a844-47cc-89d1-b8391b3dc4c5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:22.020198 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c4ffdc37-a844-47cc-89d1-b8391b3dc4c5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:22.121016 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.wsgi [None req-c4ffdc37-a844-47cc-89d1-b8391b3dc4c5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] HTTP exception thrown: Cannot 'detach_volume' instance 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 while it is in vm_state rescued Jun 24 09:46:22.122642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-c4ffdc37-a844-47cc-89d1-b8391b3dc4c5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Request method failure captured: Jun 24 09:46:22.122642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: DELETE /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/os-volume_attachments/7c34544f-fdf0-4051-a160-0d7e3da44272 HTTP/1.1 Jun 24 09:46:22.122642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:46:22.122642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:46:22.122642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:46:22.122642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 0 Jun 24 09:46:22.122642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:46:22.122642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:46:22.122642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:46:22.122642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:46:22.122642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYbrg1PFIJaE9KsLUkvfj5MGavywSW_6-kKNWqXQtMtDM4NGVpy2qoJduFdeKzE6JHx1qIp1dD60a2_pl3EM8bMnRc1lIgF53oVZQgvtfcVbKMZo8_PxCPUz_4f9wAr5YVr6deH_wK059J2iU44YLzWTfVVv_g1WXnpsuU6S2iDXqX0 Jun 24 09:46:22.122642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:46:22.122642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:46:22.122642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:46:22.122642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:46:22.122642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:46:22.122642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:46:22.122642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: 42946f76423740028ae43dc6a49cbbda Jun 24 09:46:22.122642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2069816343 Jun 24 09:46:22.122642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:46:22.122642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:46:22.124123 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_42946f76423740028ae43dc6a49cbbda", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/42946f76423740028ae43dc6a49cbbda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/42946f76423740028ae43dc6a49cbbda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/42946f76423740028ae43dc6a49cbbda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:46:22.124123 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2069816343 Jun 24 09:46:22.124123 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: 42946f76423740028ae43dc6a49cbbda Jun 24 09:46:22.124123 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2069816343 Jun 24 09:46:22.124123 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-ServerRescueNegativeTestJSON-2069816343-project Jun 24 09:46:22.124123 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:46:22.124123 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:46:22.124123 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: d5e6d9fad06449c1b43254df442d224f Jun 24 09:46:22.124123 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2069816343-project Jun 24 09:46:22.124123 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: > Jun 24 09:46:22.124123 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Cannot 'detach_volume' instance 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 while it is in vm_state rescued Jun 24 09:46:22.125125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'server_id': '7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64', 'id': '7c34544f-fdf0-4051-a160-0d7e3da44272'} Jun 24 09:46:22.125125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:46:22.125125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:46:22.125125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 24 09:46:22.125125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 24 09:46:22.125125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 09:46:22.125125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:46:22.125125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 24 09:46:22.125125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 24 09:46:22.125125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 24 09:46:22.125125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:46:22.125125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:46:22.125125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:46:22.125125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:46:22.125125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:46:22.125125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:46:22.125125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:46:22.125125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:46:22.125125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:46:22.125125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:46:22.126772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 24 09:46:22.126772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 24 09:46:22.126772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 24 09:46:22.126772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 24 09:46:22.126772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 while it is in vm_state rescued Jun 24 09:46:22.126772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:46:22.126772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:46:22.126772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:46:22.126772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:46:22.126772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:46:22.126772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:46:22.126772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:46:22.126772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:46:22.126772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 while it is in vm_state rescued Jun 24 09:46:22.126772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:46:22.126772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-c4ffdc37-a844-47cc-89d1-b8391b3dc4c5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Returning 409 to user: Cannot 'detach_volume' instance 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 while it is in vm_state rescued {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:46:22.128048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-c4ffdc37-a844-47cc-89d1-b8391b3dc4c5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/os-volume_attachments/7c34544f-fdf0-4051-a160-0d7e3da44272" status: 409 len: 152 microversion: 2.1 time: 0.117605 Jun 24 09:46:22.128048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 292/605] 10.222.0.65 () {58 vars in 1415 bytes} [Fri Jun 24 09:46:22 2022] DELETE /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/os-volume_attachments/7c34544f-fdf0-4051-a160-0d7e3da44272 => generated 152 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 24 09:46:22.136981 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-eb7dbda6-509c-408d-b8c6-98472839195a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:46:22.138101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-eb7dbda6-509c-408d-b8c6-98472839195a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:22.151011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eb7dbda6-509c-408d-b8c6-98472839195a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:22.151561 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eb7dbda6-509c-408d-b8c6-98472839195a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:22.152353 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eb7dbda6-509c-408d-b8c6-98472839195a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:22.152773 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eb7dbda6-509c-408d-b8c6-98472839195a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:22.245495 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-eb7dbda6-509c-408d-b8c6-98472839195a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "POST /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/action" status: 202 len: 0 microversion: 2.1 time: 0.115207 Jun 24 09:46:22.246266 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 314/606] 10.222.0.65 () {60 vars in 1277 bytes} [Fri Jun 24 09:46:22 2022] POST /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:46:22.258296 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-f66f0d27-6239-436b-80d5-733577abca50 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:22.258834 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-f66f0d27-6239-436b-80d5-733577abca50 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:22.267765 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f66f0d27-6239-436b-80d5-733577abca50 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:22.268214 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f66f0d27-6239-436b-80d5-733577abca50 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:22.268989 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f66f0d27-6239-436b-80d5-733577abca50 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:22.269422 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f66f0d27-6239-436b-80d5-733577abca50 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:22.426445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f66f0d27-6239-436b-80d5-733577abca50 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:22.435957 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-f66f0d27-6239-436b-80d5-733577abca50 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1722 microversion: 2.1 time: 0.183429 Jun 24 09:46:22.436541 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 293/607] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:22 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:22.530250 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b0bf2bad-0be5-4691-9ee0-e155240d283f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:22.531109 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-b0bf2bad-0be5-4691-9ee0-e155240d283f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:22.538908 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b0bf2bad-0be5-4691-9ee0-e155240d283f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:22.539377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b0bf2bad-0be5-4691-9ee0-e155240d283f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:22.540146 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b0bf2bad-0be5-4691-9ee0-e155240d283f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:22.540576 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b0bf2bad-0be5-4691-9ee0-e155240d283f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:22.686070 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b0bf2bad-0be5-4691-9ee0-e155240d283f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:22.694252 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b0bf2bad-0be5-4691-9ee0-e155240d283f tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1514 microversion: 2.1 time: 0.170306 Jun 24 09:46:22.694930 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 315/608] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:22 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:23.456752 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-a9e35329-0732-4a2a-add4-75e5bd246624 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:23.457505 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-a9e35329-0732-4a2a-add4-75e5bd246624 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:23.466994 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a9e35329-0732-4a2a-add4-75e5bd246624 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:23.467651 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a9e35329-0732-4a2a-add4-75e5bd246624 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:23.468618 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a9e35329-0732-4a2a-add4-75e5bd246624 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:23.469247 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a9e35329-0732-4a2a-add4-75e5bd246624 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:23.713626 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-af8babad-152d-40f9-9abc-1440857d5005 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:23.714522 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-af8babad-152d-40f9-9abc-1440857d5005 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:23.721070 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-af8babad-152d-40f9-9abc-1440857d5005 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:23.721519 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-af8babad-152d-40f9-9abc-1440857d5005 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:23.722297 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-af8babad-152d-40f9-9abc-1440857d5005 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:23.722777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-af8babad-152d-40f9-9abc-1440857d5005 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:24.006499 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-a9e35329-0732-4a2a-add4-75e5bd246624 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:24.015135 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-a9e35329-0732-4a2a-add4-75e5bd246624 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1722 microversion: 2.1 time: 0.562422 Jun 24 09:46:24.016060 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 294/609] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:23 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1722 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:24.023994 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-af8babad-152d-40f9-9abc-1440857d5005 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:24.031942 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-af8babad-152d-40f9-9abc-1440857d5005 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1514 microversion: 2.1 time: 0.322445 Jun 24 09:46:24.032513 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 316/610] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:23 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1514 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:46:24.256744 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-4c1daa48-d033-440c-841a-34751bba654a req-b8227d61-69ed-47a9-821a-7bacd5739fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9395b1a-996b-49cf-93c7-44f262a92968", "name": "network-vif-deleted", "tag": "a1b8e69a-e08f-4ca9-bfeb-3053eac1f832"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:46:24.266996 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-4c1daa48-d033-440c-841a-34751bba654a req-b8227d61-69ed-47a9-821a-7bacd5739fb9 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:24.267450 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-4c1daa48-d033-440c-841a-34751bba654a req-b8227d61-69ed-47a9-821a-7bacd5739fb9 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:24.279711 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-4c1daa48-d033-440c-841a-34751bba654a req-b8227d61-69ed-47a9-821a-7bacd5739fb9 service nova] Creating event network-vif-deleted:a1b8e69a-e08f-4ca9-bfeb-3053eac1f832 for instance a9395b1a-996b-49cf-93c7-44f262a92968 on hv-cinder-80382 Jun 24 09:46:24.285075 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-4c1daa48-d033-440c-841a-34751bba654a req-b8227d61-69ed-47a9-821a-7bacd5739fb9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032789 Jun 24 09:46:24.285655 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 295/611] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:46:25.036718 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-00a130fc-f7b5-4233-b3c4-9c4a4f0ade9c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:25.037529 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-00a130fc-f7b5-4233-b3c4-9c4a4f0ade9c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:25.046309 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-00a130fc-f7b5-4233-b3c4-9c4a4f0ade9c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:25.046766 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-00a130fc-f7b5-4233-b3c4-9c4a4f0ade9c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:25.047576 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-00a130fc-f7b5-4233-b3c4-9c4a4f0ade9c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:25.048038 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-00a130fc-f7b5-4233-b3c4-9c4a4f0ade9c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:25.050393 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-587f7b69-bebc-4405-a853-99f7be6b2c2b tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:25.051007 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-587f7b69-bebc-4405-a853-99f7be6b2c2b tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:25.059119 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-587f7b69-bebc-4405-a853-99f7be6b2c2b tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:25.059495 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-587f7b69-bebc-4405-a853-99f7be6b2c2b tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:25.060257 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-587f7b69-bebc-4405-a853-99f7be6b2c2b tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:25.060684 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-587f7b69-bebc-4405-a853-99f7be6b2c2b tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:25.154076 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-587f7b69-bebc-4405-a853-99f7be6b2c2b tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:25.168181 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-587f7b69-bebc-4405-a853-99f7be6b2c2b tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1472 microversion: 2.1 time: 0.122490 Jun 24 09:46:25.168770 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 296/612] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:25 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1472 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:25.216787 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-00a130fc-f7b5-4233-b3c4-9c4a4f0ade9c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:25.225438 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-00a130fc-f7b5-4233-b3c4-9c4a4f0ade9c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1722 microversion: 2.1 time: 0.195249 Jun 24 09:46:25.226073 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 317/613] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:25 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:26.187217 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-710df232-a18a-4286-8719-59bb69d1113a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:26.187843 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-710df232-a18a-4286-8719-59bb69d1113a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:26.195285 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-710df232-a18a-4286-8719-59bb69d1113a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:26.195583 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-710df232-a18a-4286-8719-59bb69d1113a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:26.197092 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-710df232-a18a-4286-8719-59bb69d1113a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:26.197653 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-710df232-a18a-4286-8719-59bb69d1113a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:26.238743 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-710df232-a18a-4286-8719-59bb69d1113a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:26.239296 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-710df232-a18a-4286-8719-59bb69d1113a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:26.239837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.objects.instance [None req-710df232-a18a-4286-8719-59bb69d1113a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lazy-loading 'fault' on Instance uuid a9395b1a-996b-49cf-93c7-44f262a92968 {{(pid=124338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:46:26.246631 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-2f67bfff-1d87-4d9e-8732-207dd77c6e78 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:26.247635 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-2f67bfff-1d87-4d9e-8732-207dd77c6e78 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:26.255292 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2f67bfff-1d87-4d9e-8732-207dd77c6e78 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:26.263966 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2f67bfff-1d87-4d9e-8732-207dd77c6e78 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:26.270638 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2f67bfff-1d87-4d9e-8732-207dd77c6e78 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:26.271454 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2f67bfff-1d87-4d9e-8732-207dd77c6e78 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:26.285486 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-710df232-a18a-4286-8719-59bb69d1113a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8df9faa4dd4eeeb724e891cdb55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b043de82f1b43f78e3b92d375111d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:26.294052 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-710df232-a18a-4286-8719-59bb69d1113a tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 200 len: 1309 microversion: 2.1 time: 0.110742 Jun 24 09:46:26.294612 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 297/614] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:26 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 1309 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:26.424923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-2f67bfff-1d87-4d9e-8732-207dd77c6e78 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:26.433348 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-2f67bfff-1d87-4d9e-8732-207dd77c6e78 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1728 microversion: 2.1 time: 0.193436 Jun 24 09:46:26.433930 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 318/615] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:26 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1728 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:26.449919 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ec744c71-b091-4651-8c7d-d346f47818dc tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:26.450426 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ec744c71-b091-4651-8c7d-d346f47818dc tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:26.456820 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ec744c71-b091-4651-8c7d-d346f47818dc tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:26.457306 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ec744c71-b091-4651-8c7d-d346f47818dc tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:26.458073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ec744c71-b091-4651-8c7d-d346f47818dc tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:26.458504 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ec744c71-b091-4651-8c7d-d346f47818dc tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:26.545042 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ec744c71-b091-4651-8c7d-d346f47818dc tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098973 Jun 24 09:46:26.545579 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 298/616] 10.222.0.65 () {58 vars in 1274 bytes} [Fri Jun 24 09:46:26 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:46:27.311618 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-eb40d8cb-154d-4de8-b9dd-337567ce83b4 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:27.312223 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-eb40d8cb-154d-4de8-b9dd-337567ce83b4 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] [instance: a9395b1a-996b-49cf-93c7-44f262a92968] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:27.314855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:27.320504 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eb40d8cb-154d-4de8-b9dd-337567ce83b4 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:27.320983 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eb40d8cb-154d-4de8-b9dd-337567ce83b4 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:27.321950 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eb40d8cb-154d-4de8-b9dd-337567ce83b4 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:27.322383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eb40d8cb-154d-4de8-b9dd-337567ce83b4 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:27.338931 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-eb40d8cb-154d-4de8-b9dd-337567ce83b4 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] HTTP exception thrown: Instance a9395b1a-996b-49cf-93c7-44f262a92968 could not be found. Jun 24 09:46:27.340689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-eb40d8cb-154d-4de8-b9dd-337567ce83b4 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Request method failure captured: Jun 24 09:46:27.340689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 HTTP/1.1 Jun 24 09:46:27.340689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:46:27.340689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:46:27.340689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:46:27.340689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:46:27.340689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:46:27.340689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:46:27.340689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:46:27.340689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:46:27.340689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYcxwGXEovy-LGVwp4qX64FQhGvHGFsEZW4zChV_HUAM-YiOamDTzYYgumJBSLkR-jla0pvJWTJeWzmeCkUAK_6asCf-dePlKoSzD2y8A1P1OfDmzeMH3VDLANCtrB9eaBHijbtczNcE_ybKwiC1TXlu--9pkGeIW6UfmHlYAKJe_a8 Jun 24 09:46:27.340689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:46:27.340689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:46:27.340689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:46:27.340689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:46:27.340689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:46:27.340689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:46:27.340689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 2b043de82f1b43f78e3b92d375111d91 Jun 24 09:46:27.340689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1617955141 Jun 24 09:46:27.340689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:46:27.340689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:46:27.341975 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2b043de82f1b43f78e3b92d375111d91", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2b043de82f1b43f78e3b92d375111d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2b043de82f1b43f78e3b92d375111d91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2b043de82f1b43f78e3b92d375111d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:46:27.341975 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-VolumesSnapshotTestJSON-1617955141 Jun 24 09:46:27.341975 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 2b043de82f1b43f78e3b92d375111d91 Jun 24 09:46:27.341975 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1617955141 Jun 24 09:46:27.341975 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-VolumesSnapshotTestJSON-1617955141-project Jun 24 09:46:27.341975 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:46:27.341975 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:46:27.341975 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: 7f8df9faa4dd4eeeb724e891cdb55616 Jun 24 09:46:27.341975 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-VolumesSnapshotTestJSON-1617955141-project Jun 24 09:46:27.341975 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:46:27.341975 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance a9395b1a-996b-49cf-93c7-44f262a92968 could not be found. Jun 24 09:46:27.341975 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': 'a9395b1a-996b-49cf-93c7-44f262a92968'} Jun 24 09:46:27.342730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:46:27.342730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:46:27.342730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:46:27.342730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:46:27.342730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:46:27.342730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:46:27.342730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:46:27.342730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:46:27.342730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:46:27.342730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:46:27.342730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9395b1a-996b-49cf-93c7-44f262a92968 could not be found. Jun 24 09:46:27.342730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:46:27.342730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:46:27.342730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:46:27.342730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:46:27.342730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:46:27.342730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:46:27.342730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:46:27.342730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:46:27.342730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:46:27.344643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:46:27.344643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:46:27.344643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:46:27.344643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:46:27.344643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:46:27.344643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:46:27.344643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:46:27.344643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9395b1a-996b-49cf-93c7-44f262a92968 could not be found. Jun 24 09:46:27.344643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:46:27.344643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:46:27.344643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:46:27.344643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:46:27.344643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:46:27.344643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:46:27.344643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:46:27.344643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:46:27.344643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9395b1a-996b-49cf-93c7-44f262a92968 could not be found. Jun 24 09:46:27.344643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:46:27.345725 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-eb40d8cb-154d-4de8-b9dd-337567ce83b4 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] Returning 404 to user: Instance a9395b1a-996b-49cf-93c7-44f262a92968 could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:46:27.347902 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-eb40d8cb-154d-4de8-b9dd-337567ce83b4 tempest-VolumesSnapshotTestJSON-1617955141 tempest-VolumesSnapshotTestJSON-1617955141-project] 10.222.0.65 "GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968" status: 404 len: 111 microversion: 2.1 time: 0.034560 Jun 24 09:46:27.349713 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 319/617] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:27 2022] GET /compute/v2.1/servers/a9395b1a-996b-49cf-93c7-44f262a92968 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:46:27.466481 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-1c415875-8691-4758-aea6-fcbfdc67066f req-5fcb9fcb-d9b2-41f3-bd90-940c3be4f8fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64", "tag": "604c79af-8cff-4ce1-90d3-2991416e7b7f"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:46:27.476340 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-1c415875-8691-4758-aea6-fcbfdc67066f req-5fcb9fcb-d9b2-41f3-bd90-940c3be4f8fb service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:27.477085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-1c415875-8691-4758-aea6-fcbfdc67066f req-5fcb9fcb-d9b2-41f3-bd90-940c3be4f8fb service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:27.490091 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-1c415875-8691-4758-aea6-fcbfdc67066f req-5fcb9fcb-d9b2-41f3-bd90-940c3be4f8fb service nova] Creating event network-changed:604c79af-8cff-4ce1-90d3-2991416e7b7f for instance 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 on hv-cinder-80382 Jun 24 09:46:27.496962 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-1c415875-8691-4758-aea6-fcbfdc67066f req-5fcb9fcb-d9b2-41f3-bd90-940c3be4f8fb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035233 Jun 24 09:46:27.497855 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 299/618] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:46:29.521263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-56ae4dcf-487d-4904-94b8-ba1dc5fe6cad req-230aaa49-645a-43a9-aad3-0d7e9e4a38fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64", "tag": "604c79af-8cff-4ce1-90d3-2991416e7b7f"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:46:29.531279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-56ae4dcf-487d-4904-94b8-ba1dc5fe6cad req-230aaa49-645a-43a9-aad3-0d7e9e4a38fc service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:29.531728 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-56ae4dcf-487d-4904-94b8-ba1dc5fe6cad req-230aaa49-645a-43a9-aad3-0d7e9e4a38fc service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:29.543665 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-56ae4dcf-487d-4904-94b8-ba1dc5fe6cad req-230aaa49-645a-43a9-aad3-0d7e9e4a38fc service nova] Creating event network-changed:604c79af-8cff-4ce1-90d3-2991416e7b7f for instance 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 on hv-cinder-80382 Jun 24 09:46:29.548763 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-56ae4dcf-487d-4904-94b8-ba1dc5fe6cad req-230aaa49-645a-43a9-aad3-0d7e9e4a38fc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034499 Jun 24 09:46:29.549315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 320/619] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:46:30.610931 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-58d4a12f-754b-43c1-89e4-905f408ddbd2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:46:30.612477 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-58d4a12f-754b-43c1-89e4-905f408ddbd2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:30.622582 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-58d4a12f-754b-43c1-89e4-905f408ddbd2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:30.623409 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-58d4a12f-754b-43c1-89e4-905f408ddbd2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:30.624483 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-58d4a12f-754b-43c1-89e4-905f408ddbd2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:30.625249 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-58d4a12f-754b-43c1-89e4-905f408ddbd2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:30.694248 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:30.706719 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-58d4a12f-754b-43c1-89e4-905f408ddbd2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "POST /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/action" status: 202 len: 0 microversion: 2.1 time: 0.102064 Jun 24 09:46:30.707399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 300/620] 10.222.0.65 () {60 vars in 1277 bytes} [Fri Jun 24 09:46:30 2022] POST /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:46:30.717030 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-627f4352-5c69-43ed-9873-33610cec19f2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:30.717742 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-627f4352-5c69-43ed-9873-33610cec19f2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:30.724531 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-627f4352-5c69-43ed-9873-33610cec19f2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:30.724998 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-627f4352-5c69-43ed-9873-33610cec19f2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:30.725764 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-627f4352-5c69-43ed-9873-33610cec19f2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:30.726206 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-627f4352-5c69-43ed-9873-33610cec19f2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:30.871830 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-627f4352-5c69-43ed-9873-33610cec19f2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:30.885338 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-627f4352-5c69-43ed-9873-33610cec19f2 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1751 microversion: 2.1 time: 0.172767 Jun 24 09:46:30.886204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 321/621] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:30 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:46:31.909966 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-78bfa7e5-024b-48e0-9360-172cffa35b4d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:31.911395 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-78bfa7e5-024b-48e0-9360-172cffa35b4d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:31.918893 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-78bfa7e5-024b-48e0-9360-172cffa35b4d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:31.919549 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-78bfa7e5-024b-48e0-9360-172cffa35b4d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:31.920277 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-78bfa7e5-024b-48e0-9360-172cffa35b4d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:31.920726 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-78bfa7e5-024b-48e0-9360-172cffa35b4d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:32.158503 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-78bfa7e5-024b-48e0-9360-172cffa35b4d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:32.167354 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-78bfa7e5-024b-48e0-9360-172cffa35b4d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1751 microversion: 2.1 time: 0.262531 Jun 24 09:46:32.167864 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 301/622] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:31 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1751 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:33.184994 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-75f799fb-6efe-4b7f-9fbd-a64848618899 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:33.185625 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-75f799fb-6efe-4b7f-9fbd-a64848618899 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:33.192420 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-75f799fb-6efe-4b7f-9fbd-a64848618899 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:33.192907 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-75f799fb-6efe-4b7f-9fbd-a64848618899 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:33.193665 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-75f799fb-6efe-4b7f-9fbd-a64848618899 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:33.194090 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-75f799fb-6efe-4b7f-9fbd-a64848618899 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:33.350192 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-75f799fb-6efe-4b7f-9fbd-a64848618899 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:33.358512 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-75f799fb-6efe-4b7f-9fbd-a64848618899 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1756 microversion: 2.1 time: 0.177583 Jun 24 09:46:33.359104 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 322/623] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:33 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:34.376318 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-95e89220-5771-4993-905e-56e60884fd44 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:34.376934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-95e89220-5771-4993-905e-56e60884fd44 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:34.383651 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-95e89220-5771-4993-905e-56e60884fd44 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:34.384125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-95e89220-5771-4993-905e-56e60884fd44 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:34.384897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-95e89220-5771-4993-905e-56e60884fd44 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:34.385766 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-95e89220-5771-4993-905e-56e60884fd44 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:34.536731 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-95e89220-5771-4993-905e-56e60884fd44 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:34.544901 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-95e89220-5771-4993-905e-56e60884fd44 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1756 microversion: 2.1 time: 0.172502 Jun 24 09:46:34.545562 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 302/624] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:34 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:35.566532 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-41b3ca9e-8b7a-4449-8807-993654bd0d4b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:35.567213 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-41b3ca9e-8b7a-4449-8807-993654bd0d4b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:35.579139 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-41b3ca9e-8b7a-4449-8807-993654bd0d4b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:35.579915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-41b3ca9e-8b7a-4449-8807-993654bd0d4b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:35.581265 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-41b3ca9e-8b7a-4449-8807-993654bd0d4b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:35.581975 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-41b3ca9e-8b7a-4449-8807-993654bd0d4b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:35.733431 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-41b3ca9e-8b7a-4449-8807-993654bd0d4b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:35.741736 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-41b3ca9e-8b7a-4449-8807-993654bd0d4b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1756 microversion: 2.1 time: 0.182185 Jun 24 09:46:35.742445 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 323/625] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:35 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:36.760139 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-3133c11d-7937-4957-9801-92cf7edd7f5d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:36.761072 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-3133c11d-7937-4957-9801-92cf7edd7f5d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:36.768277 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3133c11d-7937-4957-9801-92cf7edd7f5d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:36.768727 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3133c11d-7937-4957-9801-92cf7edd7f5d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:36.769486 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3133c11d-7937-4957-9801-92cf7edd7f5d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:36.769922 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3133c11d-7937-4957-9801-92cf7edd7f5d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:36.939773 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-3133c11d-7937-4957-9801-92cf7edd7f5d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:36.949160 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-3133c11d-7937-4957-9801-92cf7edd7f5d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1756 microversion: 2.1 time: 0.192856 Jun 24 09:46:36.949909 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 303/626] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:36 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:37.969497 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-006b91b9-ee66-46be-98f0-a56c3e71bbcd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:37.970155 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-006b91b9-ee66-46be-98f0-a56c3e71bbcd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:37.980266 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-006b91b9-ee66-46be-98f0-a56c3e71bbcd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:37.980720 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-006b91b9-ee66-46be-98f0-a56c3e71bbcd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:37.981489 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-006b91b9-ee66-46be-98f0-a56c3e71bbcd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:37.981919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-006b91b9-ee66-46be-98f0-a56c3e71bbcd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:38.129393 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-006b91b9-ee66-46be-98f0-a56c3e71bbcd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:38.133017 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:38.138830 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-006b91b9-ee66-46be-98f0-a56c3e71bbcd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1756 microversion: 2.1 time: 0.175864 Jun 24 09:46:38.139433 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 324/627] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:37 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:39.156635 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-857959d6-2864-4b27-a464-e156edb54b65 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:39.157189 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-857959d6-2864-4b27-a464-e156edb54b65 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:39.164261 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-857959d6-2864-4b27-a464-e156edb54b65 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:39.164713 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-857959d6-2864-4b27-a464-e156edb54b65 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:39.165483 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-857959d6-2864-4b27-a464-e156edb54b65 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:39.165920 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-857959d6-2864-4b27-a464-e156edb54b65 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:39.315263 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-857959d6-2864-4b27-a464-e156edb54b65 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:39.323959 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-857959d6-2864-4b27-a464-e156edb54b65 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1756 microversion: 2.1 time: 0.171203 Jun 24 09:46:39.324546 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 304/628] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:39 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:40.164786 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-6d86f84f-1fa0-46fb-881f-fe2acd113f64 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:40.165609 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-6d86f84f-1fa0-46fb-881f-fe2acd113f64 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:40.173668 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6d86f84f-1fa0-46fb-881f-fe2acd113f64 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:40.174104 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6d86f84f-1fa0-46fb-881f-fe2acd113f64 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:40.174887 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6d86f84f-1fa0-46fb-881f-fe2acd113f64 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:40.175355 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6d86f84f-1fa0-46fb-881f-fe2acd113f64 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:40.206877 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-6d86f84f-1fa0-46fb-881f-fe2acd113f64 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69/os-volume_attachments/b49c294a-a77e-4c82-af10-41db5005addc" status: 200 len: 194 microversion: 2.20 time: 0.050259 Jun 24 09:46:40.207487 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 325/629] 10.222.0.65 () {60 vars in 1453 bytes} [Fri Jun 24 09:46:40 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69/os-volume_attachments/b49c294a-a77e-4c82-af10-41db5005addc => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:46:40.274566 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-abb534c2-07de-44d9-ac62-d58c2ec89b0f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:40.275171 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-abb534c2-07de-44d9-ac62-d58c2ec89b0f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:40.284076 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-abb534c2-07de-44d9-ac62-d58c2ec89b0f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:40.285025 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-abb534c2-07de-44d9-ac62-d58c2ec89b0f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:40.286240 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-abb534c2-07de-44d9-ac62-d58c2ec89b0f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:40.287008 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-abb534c2-07de-44d9-ac62-d58c2ec89b0f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:40.341535 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1697fa70-1c22-4ff6-95c4-bddb468177d9 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:40.342172 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-1697fa70-1c22-4ff6-95c4-bddb468177d9 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:40.348588 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1697fa70-1c22-4ff6-95c4-bddb468177d9 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:40.349035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1697fa70-1c22-4ff6-95c4-bddb468177d9 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:40.349807 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1697fa70-1c22-4ff6-95c4-bddb468177d9 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:40.350234 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1697fa70-1c22-4ff6-95c4-bddb468177d9 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:40.372559 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.objects.instance [None req-abb534c2-07de-44d9-ac62-d58c2ec89b0f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lazy-loading 'services' on Instance uuid aa551ac0-154e-4145-acc0-725155004e69 {{(pid=124338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:46:40.448519 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-abb534c2-07de-44d9-ac62-d58c2ec89b0f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "DELETE /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69/os-volume_attachments/b49c294a-a77e-4c82-af10-41db5005addc" status: 202 len: 0 microversion: 2.20 time: 0.178394 Jun 24 09:46:40.449107 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 305/630] 10.222.0.65 () {60 vars in 1456 bytes} [Fri Jun 24 09:46:40 2022] DELETE /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69/os-volume_attachments/b49c294a-a77e-4c82-af10-41db5005addc => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:46:40.458186 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-e6633e18-1ef1-47d3-8ea8-3ba37d5e019e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:40.459291 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-e6633e18-1ef1-47d3-8ea8-3ba37d5e019e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:40.466007 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e6633e18-1ef1-47d3-8ea8-3ba37d5e019e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:40.466471 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e6633e18-1ef1-47d3-8ea8-3ba37d5e019e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:40.467658 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e6633e18-1ef1-47d3-8ea8-3ba37d5e019e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:40.468119 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e6633e18-1ef1-47d3-8ea8-3ba37d5e019e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:40.499422 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-e6633e18-1ef1-47d3-8ea8-3ba37d5e019e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045297 Jun 24 09:46:40.500005 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 306/631] 10.222.0.65 () {60 vars in 1342 bytes} [Fri Jun 24 09:46:40 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 09:46:40.511861 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-1697fa70-1c22-4ff6-95c4-bddb468177d9 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:40.520988 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-1697fa70-1c22-4ff6-95c4-bddb468177d9 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1756 microversion: 2.1 time: 0.183434 Jun 24 09:46:40.521574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 326/632] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:40 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:46:41.512154 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-e469308a-b5ee-44d3-811f-1d92d59599d4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:41.513422 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-e469308a-b5ee-44d3-811f-1d92d59599d4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:41.522221 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e469308a-b5ee-44d3-811f-1d92d59599d4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:41.523329 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e469308a-b5ee-44d3-811f-1d92d59599d4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:41.524663 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e469308a-b5ee-44d3-811f-1d92d59599d4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:41.525204 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e469308a-b5ee-44d3-811f-1d92d59599d4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:41.538430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-9a7bdcd0-42a1-411e-b9f9-a6c0019877a0 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:41.539765 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-9a7bdcd0-42a1-411e-b9f9-a6c0019877a0 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:41.551527 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9a7bdcd0-42a1-411e-b9f9-a6c0019877a0 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:41.551980 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9a7bdcd0-42a1-411e-b9f9-a6c0019877a0 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:41.552759 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9a7bdcd0-42a1-411e-b9f9-a6c0019877a0 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:41.553199 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9a7bdcd0-42a1-411e-b9f9-a6c0019877a0 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:41.578049 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-e469308a-b5ee-44d3-811f-1d92d59599d4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.070698 Jun 24 09:46:41.578746 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 307/633] 10.222.0.65 () {60 vars in 1342 bytes} [Fri Jun 24 09:46:41 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:46:41.639385 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-fc643e30-f91b-4896-a440-00b1775af4ce tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:41.639886 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-fc643e30-f91b-4896-a440-00b1775af4ce tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:41.645859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fc643e30-f91b-4896-a440-00b1775af4ce tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:41.646308 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fc643e30-f91b-4896-a440-00b1775af4ce tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:41.647100 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fc643e30-f91b-4896-a440-00b1775af4ce tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:41.647542 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fc643e30-f91b-4896-a440-00b1775af4ce tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:41.674070 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-fc643e30-f91b-4896-a440-00b1775af4ce tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Going to try to terminate instance {{(pid=124338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:46:41.717515 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-9a7bdcd0-42a1-411e-b9f9-a6c0019877a0 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:41.726343 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-9a7bdcd0-42a1-411e-b9f9-a6c0019877a0 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1756 microversion: 2.1 time: 0.191894 Jun 24 09:46:41.726919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 327/634] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:41 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:41.756261 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-fc643e30-f91b-4896-a440-00b1775af4ce tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "DELETE /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 204 len: 0 microversion: 2.20 time: 0.120451 Jun 24 09:46:41.756850 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 308/635] 10.222.0.65 () {60 vars in 1279 bytes} [Fri Jun 24 09:46:41 2022] DELETE /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 24 09:46:41.767537 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b904d7b0-640f-4f93-9340-d351bf7af11f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:41.768417 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-b904d7b0-640f-4f93-9340-d351bf7af11f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:41.777771 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b904d7b0-640f-4f93-9340-d351bf7af11f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:41.779095 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b904d7b0-640f-4f93-9340-d351bf7af11f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:41.780220 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b904d7b0-640f-4f93-9340-d351bf7af11f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:41.780812 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b904d7b0-640f-4f93-9340-d351bf7af11f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:41.921808 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b904d7b0-640f-4f93-9340-d351bf7af11f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:41.930233 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b904d7b0-640f-4f93-9340-d351bf7af11f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:41.931841 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b904d7b0-640f-4f93-9340-d351bf7af11f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:41.933081 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b904d7b0-640f-4f93-9340-d351bf7af11f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.171660 Jun 24 09:46:41.933651 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 328/636] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:46:41 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:46:42.744749 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-e685927d-d567-48e8-b854-d6bef311d48d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:42.745420 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-e685927d-d567-48e8-b854-d6bef311d48d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:42.752913 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e685927d-d567-48e8-b854-d6bef311d48d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:42.753592 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e685927d-d567-48e8-b854-d6bef311d48d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:42.754302 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e685927d-d567-48e8-b854-d6bef311d48d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:42.754812 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e685927d-d567-48e8-b854-d6bef311d48d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:42.907632 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-e685927d-d567-48e8-b854-d6bef311d48d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:42.920089 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-e685927d-d567-48e8-b854-d6bef311d48d tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1756 microversion: 2.1 time: 0.179252 Jun 24 09:46:42.920842 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 309/637] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:42 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:42.955059 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-67bac2bb-8d44-4ec3-a09d-87017fbaced6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:42.955684 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-67bac2bb-8d44-4ec3-a09d-87017fbaced6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:42.965425 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-67bac2bb-8d44-4ec3-a09d-87017fbaced6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:42.965885 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-67bac2bb-8d44-4ec3-a09d-87017fbaced6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:42.966673 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-67bac2bb-8d44-4ec3-a09d-87017fbaced6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:42.967102 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-67bac2bb-8d44-4ec3-a09d-87017fbaced6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:43.121259 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-67bac2bb-8d44-4ec3-a09d-87017fbaced6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:43.130019 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-67bac2bb-8d44-4ec3-a09d-87017fbaced6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:43.131617 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-67bac2bb-8d44-4ec3-a09d-87017fbaced6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:43.132989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-67bac2bb-8d44-4ec3-a09d-87017fbaced6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1722 microversion: 2.20 time: 0.184377 Jun 24 09:46:43.133565 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 329/638] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:46:42 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:46:43.938078 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-8133fee6-2dc3-4f42-9ec1-38c47f893529 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:43.938640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-8133fee6-2dc3-4f42-9ec1-38c47f893529 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:43.944820 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8133fee6-2dc3-4f42-9ec1-38c47f893529 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:43.945270 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8133fee6-2dc3-4f42-9ec1-38c47f893529 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:43.946037 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8133fee6-2dc3-4f42-9ec1-38c47f893529 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:43.946466 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8133fee6-2dc3-4f42-9ec1-38c47f893529 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:44.098964 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-8133fee6-2dc3-4f42-9ec1-38c47f893529 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:44.107245 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-8133fee6-2dc3-4f42-9ec1-38c47f893529 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1756 microversion: 2.1 time: 0.173401 Jun 24 09:46:44.107938 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 310/639] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:43 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:44.152262 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-43e2e867-4c36-4aa3-b309-18f3a02bce6f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:44.152847 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-43e2e867-4c36-4aa3-b309-18f3a02bce6f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:44.160233 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-43e2e867-4c36-4aa3-b309-18f3a02bce6f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:44.160668 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-43e2e867-4c36-4aa3-b309-18f3a02bce6f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:44.161433 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-43e2e867-4c36-4aa3-b309-18f3a02bce6f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:44.161858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-43e2e867-4c36-4aa3-b309-18f3a02bce6f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:44.237960 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-43e2e867-4c36-4aa3-b309-18f3a02bce6f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:44.249768 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-43e2e867-4c36-4aa3-b309-18f3a02bce6f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:44.252264 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-43e2e867-4c36-4aa3-b309-18f3a02bce6f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:44.255573 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-43e2e867-4c36-4aa3-b309-18f3a02bce6f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 200 len: 1655 microversion: 2.20 time: 0.106344 Jun 24 09:46:44.256151 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 330/640] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:46:44 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 1655 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:46:44.512404 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-290eaf9b-2948-4ae0-bfc7-fbd250e3b9ab req-e88ecebf-4c83-4358-9089-d0ac9c4a1252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa551ac0-154e-4145-acc0-725155004e69", "name": "network-vif-deleted", "tag": "371d87f0-d828-436b-a673-c5e34fc40e6c"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:46:44.523975 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-290eaf9b-2948-4ae0-bfc7-fbd250e3b9ab req-e88ecebf-4c83-4358-9089-d0ac9c4a1252 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:44.524437 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-290eaf9b-2948-4ae0-bfc7-fbd250e3b9ab req-e88ecebf-4c83-4358-9089-d0ac9c4a1252 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:44.539600 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-290eaf9b-2948-4ae0-bfc7-fbd250e3b9ab req-e88ecebf-4c83-4358-9089-d0ac9c4a1252 service nova] Creating event network-vif-deleted:371d87f0-d828-436b-a673-c5e34fc40e6c for instance aa551ac0-154e-4145-acc0-725155004e69 on hv-cinder-80382 Jun 24 09:46:44.544553 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-290eaf9b-2948-4ae0-bfc7-fbd250e3b9ab req-e88ecebf-4c83-4358-9089-d0ac9c4a1252 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037024 Jun 24 09:46:44.545972 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 311/641] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:46:45.124497 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-ffd3b3b5-bc19-4f23-966a-c7e0cb6075bd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:45.125133 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-ffd3b3b5-bc19-4f23-966a-c7e0cb6075bd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:45.132341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ffd3b3b5-bc19-4f23-966a-c7e0cb6075bd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:45.132795 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ffd3b3b5-bc19-4f23-966a-c7e0cb6075bd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:45.133653 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ffd3b3b5-bc19-4f23-966a-c7e0cb6075bd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:45.134136 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ffd3b3b5-bc19-4f23-966a-c7e0cb6075bd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:45.274645 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-73c9eca5-e833-4d99-b395-7f5213ee0d1a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:45.275406 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-73c9eca5-e833-4d99-b395-7f5213ee0d1a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:45.286485 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-73c9eca5-e833-4d99-b395-7f5213ee0d1a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:45.287227 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-73c9eca5-e833-4d99-b395-7f5213ee0d1a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:45.288198 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-73c9eca5-e833-4d99-b395-7f5213ee0d1a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:45.288794 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-73c9eca5-e833-4d99-b395-7f5213ee0d1a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:45.292170 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ffd3b3b5-bc19-4f23-966a-c7e0cb6075bd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:45.301267 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-ffd3b3b5-bc19-4f23-966a-c7e0cb6075bd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1756 microversion: 2.1 time: 0.181098 Jun 24 09:46:45.301941 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 331/642] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:45 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:45.303652 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.wsgi [None req-73c9eca5-e833-4d99-b395-7f5213ee0d1a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] HTTP exception thrown: Instance aa551ac0-154e-4145-acc0-725155004e69 could not be found. Jun 24 09:46:45.305344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-73c9eca5-e833-4d99-b395-7f5213ee0d1a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Request method failure captured: Jun 24 09:46:45.305344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 HTTP/1.1 Jun 24 09:46:45.305344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:46:45.305344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:46:45.305344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:46:45.305344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 0 Jun 24 09:46:45.305344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:46:45.305344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:46:45.305344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:46:45.305344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:46:45.305344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYburlfQdSFs4F278plB4ZGgx6ZT52NRZcMFsWY0-nTK27KnWWQK1uNzIXo_MqW9zGoQc8bds3Bf5D2rS2vof2x8JTdZB2dXuL8gw0Q0UcigCY7r2G1OhRyU2bx1HXWGh3Obw_4gDw4eO39MsyK0fKeP2_megi5gzBRaWWq2Nm58LD0 Jun 24 09:46:45.305344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:46:45.305344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:46:45.305344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:46:45.305344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:46:45.305344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 09:46:45.305344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:46:45.305344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:46:45.305344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: f64a8807499a44ababb8bb037fc3d195 Jun 24 09:46:45.305344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-66057315 Jun 24 09:46:45.305344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:46:45.305344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:46:45.306640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f64a8807499a44ababb8bb037fc3d195", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f64a8807499a44ababb8bb037fc3d195"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f64a8807499a44ababb8bb037fc3d195"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f64a8807499a44ababb8bb037fc3d195"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:46:45.306640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-AttachVolumeShelveTestJSON-66057315 Jun 24 09:46:45.306640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: f64a8807499a44ababb8bb037fc3d195 Jun 24 09:46:45.306640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-66057315 Jun 24 09:46:45.306640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-AttachVolumeShelveTestJSON-66057315-project Jun 24 09:46:45.306640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:46:45.306640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:46:45.306640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: 544cf118cc9e4aed8e7ec7e9dfe023bc Jun 24 09:46:45.306640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-AttachVolumeShelveTestJSON-66057315-project Jun 24 09:46:45.306640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: > Jun 24 09:46:45.306640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Instance aa551ac0-154e-4145-acc0-725155004e69 could not be found. Jun 24 09:46:45.306640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'id': 'aa551ac0-154e-4145-acc0-725155004e69'} Jun 24 09:46:45.307445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:46:45.307445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:46:45.307445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:46:45.307445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:46:45.307445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:46:45.307445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:46:45.307445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:46:45.307445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:46:45.307445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:46:45.307445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:46:45.307445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa551ac0-154e-4145-acc0-725155004e69 could not be found. Jun 24 09:46:45.307445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:46:45.307445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:46:45.307445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:46:45.307445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:46:45.307445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:46:45.307445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:46:45.307445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:46:45.307445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:46:45.307445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:46:45.308576 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:46:45.308576 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:46:45.308576 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:46:45.308576 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:46:45.308576 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:46:45.308576 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:46:45.308576 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:46:45.308576 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa551ac0-154e-4145-acc0-725155004e69 could not be found. Jun 24 09:46:45.308576 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:46:45.308576 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:46:45.308576 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:46:45.308576 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:46:45.308576 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:46:45.308576 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:46:45.308576 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:46:45.308576 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:46:45.308576 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa551ac0-154e-4145-acc0-725155004e69 could not be found. Jun 24 09:46:45.308576 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:46:45.309901 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-73c9eca5-e833-4d99-b395-7f5213ee0d1a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Returning 404 to user: Instance aa551ac0-154e-4145-acc0-725155004e69 could not be found. {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:46:45.309901 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-73c9eca5-e833-4d99-b395-7f5213ee0d1a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 404 len: 111 microversion: 2.20 time: 0.036548 Jun 24 09:46:45.309901 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 312/643] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:46:45 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 24 09:46:45.316003 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-fa0f734f-ee4b-477e-992f-42de3ee90dd2 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '.version_select at 0x7fc6d43fddc0>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:45.336358 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-fa0f734f-ee4b-477e-992f-42de3ee90dd2 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-137888887" status: 204 len: 0 microversion: 2.20 time: 0.024364 Jun 24 09:46:45.336962 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 332/644] 10.222.0.65 () {60 vars in 1258 bytes} [Fri Jun 24 09:46:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-137888887 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 09:46:45.982606 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-b5ac8eef-9f4b-4e72-b3cb-d4dbe2984e8f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Action: 'create', calling method: .version_select at 0x7fc6d4a41160>, body: {"keypair": {"name": "tempest-keypair-2016977405", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/LjGG6f6+4EQMMpVn2Py1tFGz2uCm3saT4jtcDIAtbHQJ9ndsiB1hw0f6pob9iwn3jqPBRZD1WE72qTMMP2aTqjLBPoLKon/vhvqClgg8syrr8U/nT26/uS1vm8hBgpg=="}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:46:45.997923 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-b5ac8eef-9f4b-4e72-b3cb-d4dbe2984e8f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Getting quotas for project f64a8807499a44ababb8bb037fc3d195. Resources: {'key_pairs'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:46:46.002246 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-b5ac8eef-9f4b-4e72-b3cb-d4dbe2984e8f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Getting quotas for user 544cf118cc9e4aed8e7ec7e9dfe023bc and project f64a8807499a44ababb8bb037fc3d195. Resources: {'key_pairs'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:46:46.025892 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-b5ac8eef-9f4b-4e72-b3cb-d4dbe2984e8f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047223 Jun 24 09:46:46.026792 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 313/645] 10.222.0.65 () {62 vars in 1199 bytes} [Fri Jun 24 09:46:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 24 09:46:46.319474 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-5f7b1d94-7571-4fba-bfcf-bbdae1efc036 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:46.320086 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-5f7b1d94-7571-4fba-bfcf-bbdae1efc036 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:46.326751 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5f7b1d94-7571-4fba-bfcf-bbdae1efc036 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:46.327524 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5f7b1d94-7571-4fba-bfcf-bbdae1efc036 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:46.328317 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5f7b1d94-7571-4fba-bfcf-bbdae1efc036 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:46.328749 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5f7b1d94-7571-4fba-bfcf-bbdae1efc036 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:46.539828 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-5f7b1d94-7571-4fba-bfcf-bbdae1efc036 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:46.548051 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-5f7b1d94-7571-4fba-bfcf-bbdae1efc036 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1759 microversion: 2.1 time: 0.233804 Jun 24 09:46:46.548628 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 333/646] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:46:46 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1759 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:46:47.473220 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ec88e3a6-769b-4385-b575-8f34411f85b4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-743932417", "imageRef": "844ad823-18a2-4abc-813c-2d1825141591", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c0ea8d6-2f6d-4edc-b8f1-5cfa8ccc4f6b"}], "security_groups": [{"name": "tempest-securitygroup--2003534729"}], "key_name": "tempest-keypair-2016977405", "user_data": "}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:46:47.480601 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:47.772008 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.network.neutron [None req-ec88e3a6-769b-4385-b575-8f34411f85b4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] validate_networks() for [('8c0ea8d6-2f6d-4edc-b8f1-5cfa8ccc4f6b', None, None, None, None, None)] {{(pid=124338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:46:48.176254 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-ec88e3a6-769b-4385-b575-8f34411f85b4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Flavor limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:46:48.176836 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-ec88e3a6-769b-4385-b575-8f34411f85b4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Image limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:46:48.177580 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-ec88e3a6-769b-4385-b575-8f34411f85b4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Flavor pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:46:48.178211 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-ec88e3a6-769b-4385-b575-8f34411f85b4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Image pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:46:48.178820 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-ec88e3a6-769b-4385-b575-8f34411f85b4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:46:48.191176 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ec88e3a6-769b-4385-b575-8f34411f85b4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:48.191572 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ec88e3a6-769b-4385-b575-8f34411f85b4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:48.192361 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ec88e3a6-769b-4385-b575-8f34411f85b4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:48.192785 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ec88e3a6-769b-4385-b575-8f34411f85b4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:48.210391 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-ec88e3a6-769b-4385-b575-8f34411f85b4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Getting quotas for project f64a8807499a44ababb8bb037fc3d195. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:46:48.214735 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-ec88e3a6-769b-4385-b575-8f34411f85b4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Getting quotas for user 544cf118cc9e4aed8e7ec7e9dfe023bc and project f64a8807499a44ababb8bb037fc3d195. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:46:48.226598 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ec88e3a6-769b-4385-b575-8f34411f85b4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Going to run 1 instances... {{(pid=124338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:46:48.228877 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ec88e3a6-769b-4385-b575-8f34411f85b4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='844ad823-18a2-4abc-813c-2d1825141591',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:46:48.280497 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ec88e3a6-769b-4385-b575-8f34411f85b4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.812938 Jun 24 09:46:48.281147 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 314/647] 10.222.0.65 () {62 vars in 1187 bytes} [Fri Jun 24 09:46:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 24 09:46:48.291788 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-ab21aff6-a5f2-493e-83f8-0c04e697ae81 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:48.292585 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-ab21aff6-a5f2-493e-83f8-0c04e697ae81 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:48.352009 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ab21aff6-a5f2-493e-83f8-0c04e697ae81 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:48.364768 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ab21aff6-a5f2-493e-83f8-0c04e697ae81 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:48.366308 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ab21aff6-a5f2-493e-83f8-0c04e697ae81 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:48.368479 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-ab21aff6-a5f2-493e-83f8-0c04e697ae81 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1281 microversion: 2.20 time: 0.079980 Jun 24 09:46:48.369015 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 334/648] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:46:48 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1281 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:46:49.387949 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-b7f49739-9509-40d1-ae90-66aa002e6fda tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:49.388594 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-b7f49739-9509-40d1-ae90-66aa002e6fda tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:49.397717 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b7f49739-9509-40d1-ae90-66aa002e6fda tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:49.398179 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b7f49739-9509-40d1-ae90-66aa002e6fda tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:49.399321 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b7f49739-9509-40d1-ae90-66aa002e6fda tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:49.399925 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b7f49739-9509-40d1-ae90-66aa002e6fda tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:49.470119 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-b7f49739-9509-40d1-ae90-66aa002e6fda tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:49.478842 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-b7f49739-9509-40d1-ae90-66aa002e6fda tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:49.480372 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-b7f49739-9509-40d1-ae90-66aa002e6fda tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:49.481483 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-b7f49739-9509-40d1-ae90-66aa002e6fda tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1339 microversion: 2.20 time: 0.098266 Jun 24 09:46:49.482010 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 315/649] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:46:49 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1339 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:46:50.500027 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-79b8af07-a899-4a20-bf01-e43fea5a76cf tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:50.500768 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-79b8af07-a899-4a20-bf01-e43fea5a76cf tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:50.508556 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-79b8af07-a899-4a20-bf01-e43fea5a76cf tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:50.509006 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-79b8af07-a899-4a20-bf01-e43fea5a76cf tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:50.509811 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-79b8af07-a899-4a20-bf01-e43fea5a76cf tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:50.510415 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-79b8af07-a899-4a20-bf01-e43fea5a76cf tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:50.812873 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-70a3c687-8314-42fc-b6b0-9f5af6800072 req-f71008d0-efd2-47a2-859f-0ffe7d6db4c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661", "tag": "6a505089-ab65-4375-b6e7-fc2f8ad2fb21"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:46:50.825171 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-70a3c687-8314-42fc-b6b0-9f5af6800072 req-f71008d0-efd2-47a2-859f-0ffe7d6db4c1 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:50.825929 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-70a3c687-8314-42fc-b6b0-9f5af6800072 req-f71008d0-efd2-47a2-859f-0ffe7d6db4c1 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:50.842776 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-70a3c687-8314-42fc-b6b0-9f5af6800072 req-f71008d0-efd2-47a2-859f-0ffe7d6db4c1 service nova] Creating event network-changed:6a505089-ab65-4375-b6e7-fc2f8ad2fb21 for instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 on hv-cinder-80382 Jun 24 09:46:50.858623 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-70a3c687-8314-42fc-b6b0-9f5af6800072 req-f71008d0-efd2-47a2-859f-0ffe7d6db4c1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055876 Jun 24 09:46:50.860112 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 316/650] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:46:50.906419 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-79b8af07-a899-4a20-bf01-e43fea5a76cf tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:50.918745 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-79b8af07-a899-4a20-bf01-e43fea5a76cf tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:50.920689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-79b8af07-a899-4a20-bf01-e43fea5a76cf tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:50.921856 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-79b8af07-a899-4a20-bf01-e43fea5a76cf tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1407 microversion: 2.20 time: 0.426205 Jun 24 09:46:50.922421 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 335/651] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:46:50 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1407 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:46:51.941286 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-0de99784-d73c-4f9e-8c0c-50389efb3137 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:51.942014 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-0de99784-d73c-4f9e-8c0c-50389efb3137 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:51.948701 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0de99784-d73c-4f9e-8c0c-50389efb3137 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:51.949151 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0de99784-d73c-4f9e-8c0c-50389efb3137 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:51.949917 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0de99784-d73c-4f9e-8c0c-50389efb3137 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:51.950351 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0de99784-d73c-4f9e-8c0c-50389efb3137 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:52.093148 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-0de99784-d73c-4f9e-8c0c-50389efb3137 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:52.101493 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-0de99784-d73c-4f9e-8c0c-50389efb3137 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:52.103001 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-0de99784-d73c-4f9e-8c0c-50389efb3137 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:52.104150 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-0de99784-d73c-4f9e-8c0c-50389efb3137 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1407 microversion: 2.20 time: 0.167482 Jun 24 09:46:52.104716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 317/652] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:46:51 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:46:53.122435 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-313b5238-9740-421f-8fec-168795075f3e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:53.123054 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-313b5238-9740-421f-8fec-168795075f3e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:53.130878 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-313b5238-9740-421f-8fec-168795075f3e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:53.131600 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-313b5238-9740-421f-8fec-168795075f3e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:53.132492 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-313b5238-9740-421f-8fec-168795075f3e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:53.133087 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-313b5238-9740-421f-8fec-168795075f3e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:53.326563 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-313b5238-9740-421f-8fec-168795075f3e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:53.339049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-313b5238-9740-421f-8fec-168795075f3e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:53.340900 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-313b5238-9740-421f-8fec-168795075f3e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:53.342394 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-313b5238-9740-421f-8fec-168795075f3e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1407 microversion: 2.20 time: 0.224076 Jun 24 09:46:53.343143 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 336/653] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:46:53 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:46:54.365702 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7415ef13-3d15-4fea-87d9-49574915c831 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:54.366904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-7415ef13-3d15-4fea-87d9-49574915c831 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:54.377477 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7415ef13-3d15-4fea-87d9-49574915c831 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:54.377932 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7415ef13-3d15-4fea-87d9-49574915c831 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:54.378720 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7415ef13-3d15-4fea-87d9-49574915c831 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:54.379170 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7415ef13-3d15-4fea-87d9-49574915c831 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:54.552589 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-7415ef13-3d15-4fea-87d9-49574915c831 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:54.556702 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:54.563170 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-7415ef13-3d15-4fea-87d9-49574915c831 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:54.564680 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-7415ef13-3d15-4fea-87d9-49574915c831 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:54.565823 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-7415ef13-3d15-4fea-87d9-49574915c831 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1407 microversion: 2.20 time: 0.207935 Jun 24 09:46:54.566396 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 318/654] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:46:54 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:46:55.584736 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4150bb2c-c8ef-407f-817f-f1f19d38a48d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:55.585485 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-4150bb2c-c8ef-407f-817f-f1f19d38a48d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:55.593254 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4150bb2c-c8ef-407f-817f-f1f19d38a48d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:55.593773 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4150bb2c-c8ef-407f-817f-f1f19d38a48d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:55.594588 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4150bb2c-c8ef-407f-817f-f1f19d38a48d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:55.595203 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4150bb2c-c8ef-407f-817f-f1f19d38a48d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:55.690083 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-6e8591f3-2c84-421b-a407-cc5f19c8d97d req-2b0da36c-264a-42d8-94b6-46a7aa564776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661", "name": "network-vif-plugged", "status": "completed", "tag": "6a505089-ab65-4375-b6e7-fc2f8ad2fb21"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:46:55.700147 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-6e8591f3-2c84-421b-a407-cc5f19c8d97d req-2b0da36c-264a-42d8-94b6-46a7aa564776 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:55.700556 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-6e8591f3-2c84-421b-a407-cc5f19c8d97d req-2b0da36c-264a-42d8-94b6-46a7aa564776 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:55.713937 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-6e8591f3-2c84-421b-a407-cc5f19c8d97d req-2b0da36c-264a-42d8-94b6-46a7aa564776 service nova] Creating event network-vif-plugged:6a505089-ab65-4375-b6e7-fc2f8ad2fb21 for instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 on hv-cinder-80382 Jun 24 09:46:55.719174 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-6e8591f3-2c84-421b-a407-cc5f19c8d97d req-2b0da36c-264a-42d8-94b6-46a7aa564776 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032770 Jun 24 09:46:55.719770 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 319/655] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:46:55.735320 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4150bb2c-c8ef-407f-817f-f1f19d38a48d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:55.743959 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4150bb2c-c8ef-407f-817f-f1f19d38a48d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:55.745609 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4150bb2c-c8ef-407f-817f-f1f19d38a48d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:55.746883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-4150bb2c-c8ef-407f-817f-f1f19d38a48d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1407 microversion: 2.20 time: 0.166572 Jun 24 09:46:55.747472 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 337/656] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:46:55 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:46:56.766197 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-b3e3d6b5-dde0-4142-9473-26e0aa86f391 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:56.766879 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-b3e3d6b5-dde0-4142-9473-26e0aa86f391 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:56.773830 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b3e3d6b5-dde0-4142-9473-26e0aa86f391 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:56.774212 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b3e3d6b5-dde0-4142-9473-26e0aa86f391 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:56.774991 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b3e3d6b5-dde0-4142-9473-26e0aa86f391 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:56.775461 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b3e3d6b5-dde0-4142-9473-26e0aa86f391 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:56.910821 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-b3e3d6b5-dde0-4142-9473-26e0aa86f391 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:56.919303 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-b3e3d6b5-dde0-4142-9473-26e0aa86f391 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:56.920846 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-b3e3d6b5-dde0-4142-9473-26e0aa86f391 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:56.921973 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-b3e3d6b5-dde0-4142-9473-26e0aa86f391 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1407 microversion: 2.20 time: 0.160966 Jun 24 09:46:56.922554 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 320/657] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:46:56 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:46:57.941848 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-0319fa61-3837-4e91-90fc-1855dd6c7e6f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:57.942518 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-0319fa61-3837-4e91-90fc-1855dd6c7e6f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:57.948984 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0319fa61-3837-4e91-90fc-1855dd6c7e6f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:57.949427 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0319fa61-3837-4e91-90fc-1855dd6c7e6f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:57.950175 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0319fa61-3837-4e91-90fc-1855dd6c7e6f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:57.950620 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0319fa61-3837-4e91-90fc-1855dd6c7e6f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:58.081473 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-0319fa61-3837-4e91-90fc-1855dd6c7e6f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:58.089533 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-0319fa61-3837-4e91-90fc-1855dd6c7e6f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:58.091046 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-0319fa61-3837-4e91-90fc-1855dd6c7e6f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:58.092228 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-0319fa61-3837-4e91-90fc-1855dd6c7e6f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1407 microversion: 2.20 time: 0.154391 Jun 24 09:46:58.092933 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 338/658] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:46:57 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:46:59.113403 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-389b010a-3609-4317-be1d-e7a1abf7e474 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:46:59.114259 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-389b010a-3609-4317-be1d-e7a1abf7e474 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:46:59.117620 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=2 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:59.118598 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=10 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:59.125538 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-389b010a-3609-4317-be1d-e7a1abf7e474 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:59.126122 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-389b010a-3609-4317-be1d-e7a1abf7e474 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:59.126999 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-389b010a-3609-4317-be1d-e7a1abf7e474 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:46:59.127600 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-389b010a-3609-4317-be1d-e7a1abf7e474 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:46:59.516431 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-389b010a-3609-4317-be1d-e7a1abf7e474 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:59.524849 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-389b010a-3609-4317-be1d-e7a1abf7e474 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:59.526349 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-389b010a-3609-4317-be1d-e7a1abf7e474 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:46:59.527503 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-389b010a-3609-4317-be1d-e7a1abf7e474 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1407 microversion: 2.20 time: 0.419407 Jun 24 09:46:59.528073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 321/659] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:46:59 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1407 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:47:00.548638 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3189dff8-ed04-42ff-bc8d-9e231f6af967 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:00.555145 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3189dff8-ed04-42ff-bc8d-9e231f6af967 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:00.557358 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=2 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:00.558856 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:00.566491 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3189dff8-ed04-42ff-bc8d-9e231f6af967 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:00.566905 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3189dff8-ed04-42ff-bc8d-9e231f6af967 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:00.567880 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3189dff8-ed04-42ff-bc8d-9e231f6af967 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:00.568490 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3189dff8-ed04-42ff-bc8d-9e231f6af967 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:00.723644 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3189dff8-ed04-42ff-bc8d-9e231f6af967 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:00.733615 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3189dff8-ed04-42ff-bc8d-9e231f6af967 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:00.735684 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3189dff8-ed04-42ff-bc8d-9e231f6af967 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:00.737212 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3189dff8-ed04-42ff-bc8d-9e231f6af967 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1599 microversion: 2.20 time: 0.193860 Jun 24 09:47:00.738052 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 339/660] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:47:00 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1599 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:47:00.758252 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-12d9404e-3a4b-4211-a840-3a4a4265e04a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:00.759484 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-12d9404e-3a4b-4211-a840-3a4a4265e04a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:00.766764 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-12d9404e-3a4b-4211-a840-3a4a4265e04a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:00.767409 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-12d9404e-3a4b-4211-a840-3a4a4265e04a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:00.768474 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-12d9404e-3a4b-4211-a840-3a4a4265e04a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:00.768914 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-12d9404e-3a4b-4211-a840-3a4a4265e04a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:00.852202 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-12d9404e-3a4b-4211-a840-3a4a4265e04a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098140 Jun 24 09:47:00.853045 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 322/661] 10.222.0.65 () {60 vars in 1315 bytes} [Fri Jun 24 09:47:00 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:47:01.823419 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-8b239c2f-d9aa-4ab6-989f-157d80057974 req-beb49b4e-c8cb-4b4e-a4b4-f195c05d00c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661", "tag": "6a505089-ab65-4375-b6e7-fc2f8ad2fb21"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:47:01.835326 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-8b239c2f-d9aa-4ab6-989f-157d80057974 req-beb49b4e-c8cb-4b4e-a4b4-f195c05d00c9 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:01.836108 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-8b239c2f-d9aa-4ab6-989f-157d80057974 req-beb49b4e-c8cb-4b4e-a4b4-f195c05d00c9 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:01.848605 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-8b239c2f-d9aa-4ab6-989f-157d80057974 req-beb49b4e-c8cb-4b4e-a4b4-f195c05d00c9 service nova] Creating event network-changed:6a505089-ab65-4375-b6e7-fc2f8ad2fb21 for instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 on hv-cinder-80382 Jun 24 09:47:01.853905 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-8b239c2f-d9aa-4ab6-989f-157d80057974 req-beb49b4e-c8cb-4b4e-a4b4-f195c05d00c9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035603 Jun 24 09:47:01.854778 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 340/662] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:03.303976 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-da9fda1c-ccf7-4e09-a7ad-f2665b786d37 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:03.304582 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-da9fda1c-ccf7-4e09-a7ad-f2665b786d37 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:03.311268 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-da9fda1c-ccf7-4e09-a7ad-f2665b786d37 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:03.311715 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-da9fda1c-ccf7-4e09-a7ad-f2665b786d37 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:03.312478 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-da9fda1c-ccf7-4e09-a7ad-f2665b786d37 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:03.312883 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-da9fda1c-ccf7-4e09-a7ad-f2665b786d37 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:03.336910 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-da9fda1c-ccf7-4e09-a7ad-f2665b786d37 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3/ips" status: 200 len: 148 microversion: 2.1 time: 0.037385 Jun 24 09:47:03.337590 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 323/663] 10.222.0.65 () {58 vars in 1247 bytes} [Fri Jun 24 09:47:03 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:04.674148 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-79b5d01e-ff3d-41ea-ba12-84c4e33da9fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2276c2cb-c0a5-494f-b9a1-e11949650341"}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:47:04.675346 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-79b5d01e-ff3d-41ea-ba12-84c4e33da9fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:04.682356 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-79b5d01e-ff3d-41ea-ba12-84c4e33da9fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:04.682801 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-79b5d01e-ff3d-41ea-ba12-84c4e33da9fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:04.683614 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-79b5d01e-ff3d-41ea-ba12-84c4e33da9fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:04.684051 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-79b5d01e-ff3d-41ea-ba12-84c4e33da9fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:04.934212 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-79b5d01e-ff3d-41ea-ba12-84c4e33da9fa tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "POST /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265133 Jun 24 09:47:04.935002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 341/664] 10.222.0.65 () {60 vars in 1322 bytes} [Fri Jun 24 09:47:04 2022] POST /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:08.585854 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-0910989f-43be-4fba-9951-b3c89bf7b98c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:08.586437 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-0910989f-43be-4fba-9951-b3c89bf7b98c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:08.595192 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0910989f-43be-4fba-9951-b3c89bf7b98c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:08.595682 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0910989f-43be-4fba-9951-b3c89bf7b98c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:08.596578 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0910989f-43be-4fba-9951-b3c89bf7b98c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:08.597377 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0910989f-43be-4fba-9951-b3c89bf7b98c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:08.680877 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.objects.instance [None req-0910989f-43be-4fba-9951-b3c89bf7b98c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lazy-loading 'services' on Instance uuid 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 {{(pid=124338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:47:08.757983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-0910989f-43be-4fba-9951-b3c89bf7b98c tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/os-volume_attachments/7c34544f-fdf0-4051-a160-0d7e3da44272" status: 202 len: 0 microversion: 2.1 time: 0.178069 Jun 24 09:47:08.758591 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 324/665] 10.222.0.65 () {58 vars in 1415 bytes} [Fri Jun 24 09:47:08 2022] DELETE /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/os-volume_attachments/7c34544f-fdf0-4051-a160-0d7e3da44272 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:47:08.768215 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-44e655dd-7cc2-48f6-a917-099ab83162a8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:08.769277 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-44e655dd-7cc2-48f6-a917-099ab83162a8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:08.776610 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-44e655dd-7cc2-48f6-a917-099ab83162a8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:08.777061 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-44e655dd-7cc2-48f6-a917-099ab83162a8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:08.777885 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-44e655dd-7cc2-48f6-a917-099ab83162a8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:08.778288 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-44e655dd-7cc2-48f6-a917-099ab83162a8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:08.805094 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:08.811045 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-44e655dd-7cc2-48f6-a917-099ab83162a8 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047271 Jun 24 09:47:08.811650 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 342/666] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:47:08 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:09.829124 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-27ecb4d0-3819-4b89-b02c-ccda542c2f6a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:09.830786 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-27ecb4d0-3819-4b89-b02c-ccda542c2f6a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:09.841922 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-27ecb4d0-3819-4b89-b02c-ccda542c2f6a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:09.842374 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-27ecb4d0-3819-4b89-b02c-ccda542c2f6a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:09.843189 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-27ecb4d0-3819-4b89-b02c-ccda542c2f6a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:09.843631 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-27ecb4d0-3819-4b89-b02c-ccda542c2f6a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:09.877121 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-27ecb4d0-3819-4b89-b02c-ccda542c2f6a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056446 Jun 24 09:47:09.877594 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 325/667] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:47:09 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:10.893592 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a5ae74e4-e9be-4e9f-8016-3f45e61ed5a1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:10.894524 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-a5ae74e4-e9be-4e9f-8016-3f45e61ed5a1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:10.901976 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a5ae74e4-e9be-4e9f-8016-3f45e61ed5a1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:10.902437 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a5ae74e4-e9be-4e9f-8016-3f45e61ed5a1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:10.903206 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a5ae74e4-e9be-4e9f-8016-3f45e61ed5a1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:10.903896 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a5ae74e4-e9be-4e9f-8016-3f45e61ed5a1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:10.934366 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-a5ae74e4-e9be-4e9f-8016-3f45e61ed5a1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046578 Jun 24 09:47:10.934917 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 343/668] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:47:10 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:11.949950 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-48e74cc3-fcf7-4ae4-88d0-8692dabb258f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:11.950890 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-48e74cc3-fcf7-4ae4-88d0-8692dabb258f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:11.960222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-48e74cc3-fcf7-4ae4-88d0-8692dabb258f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:11.960694 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-48e74cc3-fcf7-4ae4-88d0-8692dabb258f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:11.961487 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-48e74cc3-fcf7-4ae4-88d0-8692dabb258f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:11.962061 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-48e74cc3-fcf7-4ae4-88d0-8692dabb258f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:11.994929 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-48e74cc3-fcf7-4ae4-88d0-8692dabb258f tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051143 Jun 24 09:47:11.995551 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 326/669] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:47:11 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:12.558742 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-0359bdd0-5f04-4989-bd67-d7438edba232 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2276c2cb-c0a5-494f-b9a1-e11949650341"}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:47:12.559848 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-0359bdd0-5f04-4989-bd67-d7438edba232 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:12.567089 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0359bdd0-5f04-4989-bd67-d7438edba232 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:12.567540 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0359bdd0-5f04-4989-bd67-d7438edba232 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:12.568392 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0359bdd0-5f04-4989-bd67-d7438edba232 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:12.568726 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0359bdd0-5f04-4989-bd67-d7438edba232 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:12.650423 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-0359bdd0-5f04-4989-bd67-d7438edba232 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] HTTP exception thrown: Invalid volume: volume 2276c2cb-c0a5-494f-b9a1-e11949650341 is already attached to instances: e892f2df-f3bb-4a2d-8152-4bc170cff4b3 Jun 24 09:47:12.652153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-0359bdd0-5f04-4989-bd67-d7438edba232 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Request method failure captured: Jun 24 09:47:12.652153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: POST /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3/os-volume_attachments HTTP/1.1 Jun 24 09:47:12.652153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:47:12.652153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:47:12.652153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:47:12.652153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 74 Jun 24 09:47:12.652153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:47:12.652153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:47:12.652153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:47:12.652153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:47:12.652153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYbvJ3i86IfpBOV1GhbK6BjjMPGc6Tm1uaFsF_cm2jflXXzg3yQgcdVgGx8TFBVweDptNaGL-vvoreBeBGl_GS39sHCNfkE3V7sePQxiYoI7e3NRcV5C6bE6H-sdZ6Daa5bOcdZzQqk3HMpLiyCtZEkhPHZ6MJeA9vI9pz9NKdB8VSk Jun 24 09:47:12.652153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:47:12.652153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:47:12.652153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:47:12.652153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:47:12.652153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:47:12.652153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:47:12.652153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:47:12.652153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:47:12.652153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:47:12.652153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:47:12.653688 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_30033ce42b5a43b78dde38163831cea2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:47:12.653688 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:47:12.653688 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:47:12.653688 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:47:12.653688 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:47:12.653688 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:47:12.653688 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:47:12.653688 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: fd136fcda9a04a16b258301a86bde8ef Jun 24 09:47:12.653688 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:47:12.653688 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Jun 24 09:47:12.653688 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {"volumeAttachment": {"volumeId": "2276c2cb-c0a5-494f-b9a1-e11949650341"}} Jun 24 09:47:12.653688 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:47:12.654570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Invalid volume: volume 2276c2cb-c0a5-494f-b9a1-e11949650341 is already attached to instances: e892f2df-f3bb-4a2d-8152-4bc170cff4b3 Jun 24 09:47:12.654570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'server_id': 'e892f2df-f3bb-4a2d-8152-4bc170cff4b3', 'body': {'volumeAttachment': {'volumeId': '2276c2cb-c0a5-494f-b9a1-e11949650341'}}} Jun 24 09:47:12.654570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:47:12.654570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:47:12.654570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 09:47:12.654570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 09:47:12.654570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 09:47:12.654570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:47:12.654570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 09:47:12.654570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 09:47:12.654570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 24 09:47:12.654570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 24 09:47:12.654570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 24 09:47:12.654570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 24 09:47:12.654570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2276c2cb-c0a5-494f-b9a1-e11949650341 is already attached to instances: e892f2df-f3bb-4a2d-8152-4bc170cff4b3 Jun 24 09:47:12.654570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:12.654570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:47:12.654570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:12.654570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:47:12.655989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:47:12.655989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:47:12.655989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:47:12.655989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:47:12.655989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:47:12.655989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:47:12.655989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 09:47:12.655989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 09:47:12.655989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 09:47:12.655989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 09:47:12.655989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 09:47:12.655989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 09:47:12.655989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 24 09:47:12.655989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 09:47:12.655989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2276c2cb-c0a5-494f-b9a1-e11949650341 is already attached to instances: e892f2df-f3bb-4a2d-8152-4bc170cff4b3 Jun 24 09:47:12.655989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:12.655989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:47:12.655989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:12.655989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:47:12.655989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:47:12.657570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:47:12.657570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:47:12.657570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:47:12.657570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2276c2cb-c0a5-494f-b9a1-e11949650341 is already attached to instances: e892f2df-f3bb-4a2d-8152-4bc170cff4b3 Jun 24 09:47:12.657570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:12.657570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-0359bdd0-5f04-4989-bd67-d7438edba232 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Returning 400 to user: Invalid volume: volume 2276c2cb-c0a5-494f-b9a1-e11949650341 is already attached to instances: e892f2df-f3bb-4a2d-8152-4bc170cff4b3 {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:47:12.657570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-0359bdd0-5f04-4989-bd67-d7438edba232 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "POST /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099108 Jun 24 09:47:12.657570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 344/670] 10.222.0.65 () {60 vars in 1322 bytes} [Fri Jun 24 09:47:12 2022] POST /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 24 09:47:12.717341 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-534103b1-554b-4d00-bff5-98e2c1d13641 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:12.718063 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-534103b1-554b-4d00-bff5-98e2c1d13641 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:12.725020 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-534103b1-554b-4d00-bff5-98e2c1d13641 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:12.725461 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-534103b1-554b-4d00-bff5-98e2c1d13641 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:12.726252 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-534103b1-554b-4d00-bff5-98e2c1d13641 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:12.726682 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-534103b1-554b-4d00-bff5-98e2c1d13641 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:12.824701 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.objects.instance [None req-534103b1-554b-4d00-bff5-98e2c1d13641 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lazy-loading 'services' on Instance uuid e892f2df-f3bb-4a2d-8152-4bc170cff4b3 {{(pid=124338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:47:12.909223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-534103b1-554b-4d00-bff5-98e2c1d13641 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3/os-volume_attachments/2276c2cb-c0a5-494f-b9a1-e11949650341" status: 202 len: 0 microversion: 2.1 time: 0.198072 Jun 24 09:47:12.909845 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 327/671] 10.222.0.65 () {58 vars in 1415 bytes} [Fri Jun 24 09:47:12 2022] DELETE /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3/os-volume_attachments/2276c2cb-c0a5-494f-b9a1-e11949650341 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:47:12.919469 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-0218d055-c845-418b-a2a8-1d0383732df6 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:12.920428 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-0218d055-c845-418b-a2a8-1d0383732df6 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:12.928127 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0218d055-c845-418b-a2a8-1d0383732df6 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:12.928623 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0218d055-c845-418b-a2a8-1d0383732df6 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:12.929400 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0218d055-c845-418b-a2a8-1d0383732df6 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:12.929841 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0218d055-c845-418b-a2a8-1d0383732df6 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:12.962672 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-0218d055-c845-418b-a2a8-1d0383732df6 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047406 Jun 24 09:47:12.963276 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 345/672] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:47:12 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:13.007216 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-91979965-922e-49bb-94fd-58141f181312 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:13.008313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-91979965-922e-49bb-94fd-58141f181312 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:13.015899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-91979965-922e-49bb-94fd-58141f181312 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:13.016408 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-91979965-922e-49bb-94fd-58141f181312 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:13.017200 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-91979965-922e-49bb-94fd-58141f181312 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:13.017641 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-91979965-922e-49bb-94fd-58141f181312 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:13.046920 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-91979965-922e-49bb-94fd-58141f181312 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043950 Jun 24 09:47:13.048117 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 328/673] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:47:13 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 09:47:13.154083 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-ad44f9c6-ea99-4091-9c8b-0f69b0c10287 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:13.154778 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-ad44f9c6-ea99-4091-9c8b-0f69b0c10287 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:13.164786 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ad44f9c6-ea99-4091-9c8b-0f69b0c10287 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:13.165394 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ad44f9c6-ea99-4091-9c8b-0f69b0c10287 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:13.166565 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ad44f9c6-ea99-4091-9c8b-0f69b0c10287 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:13.167267 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ad44f9c6-ea99-4091-9c8b-0f69b0c10287 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:13.196771 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-ad44f9c6-ea99-4091-9c8b-0f69b0c10287 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Going to try to terminate instance {{(pid=124339) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:47:13.281255 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-ad44f9c6-ea99-4091-9c8b-0f69b0c10287 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 204 len: 0 microversion: 2.1 time: 0.130798 Jun 24 09:47:13.282166 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 346/674] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:47:13 2022] DELETE /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:47:13.290468 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-b0175938-00a5-4d7a-be44-c0449111bcc1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:13.291098 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-b0175938-00a5-4d7a-be44-c0449111bcc1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:13.297822 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b0175938-00a5-4d7a-be44-c0449111bcc1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:13.298380 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b0175938-00a5-4d7a-be44-c0449111bcc1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:13.299204 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b0175938-00a5-4d7a-be44-c0449111bcc1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:13.299640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b0175938-00a5-4d7a-be44-c0449111bcc1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:13.441957 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-b0175938-00a5-4d7a-be44-c0449111bcc1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:13.453711 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-b0175938-00a5-4d7a-be44-c0449111bcc1 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1688 microversion: 2.1 time: 0.166831 Jun 24 09:47:13.455013 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 329/675] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:13 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:13.980323 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-05a933e0-1836-422a-8b01-6922e2790f95 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:13.981748 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-05a933e0-1836-422a-8b01-6922e2790f95 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:13.990048 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-05a933e0-1836-422a-8b01-6922e2790f95 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:13.990498 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-05a933e0-1836-422a-8b01-6922e2790f95 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:13.991308 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-05a933e0-1836-422a-8b01-6922e2790f95 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:13.991737 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-05a933e0-1836-422a-8b01-6922e2790f95 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:14.023679 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-05a933e0-1836-422a-8b01-6922e2790f95 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050760 Jun 24 09:47:14.024164 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 347/676] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:47:13 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:14.476891 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-e429d994-fef6-4595-98b8-f6017c46a55d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:14.477897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-e429d994-fef6-4595-98b8-f6017c46a55d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:14.488144 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e429d994-fef6-4595-98b8-f6017c46a55d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:14.488604 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e429d994-fef6-4595-98b8-f6017c46a55d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:14.489366 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e429d994-fef6-4595-98b8-f6017c46a55d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:14.489809 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e429d994-fef6-4595-98b8-f6017c46a55d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:14.634843 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-e429d994-fef6-4595-98b8-f6017c46a55d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:14.642922 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-e429d994-fef6-4595-98b8-f6017c46a55d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1688 microversion: 2.1 time: 0.173238 Jun 24 09:47:14.643583 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 330/677] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:14 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:15.038565 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-aacac164-ce64-4451-ae98-341d7843c73e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:15.039754 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-aacac164-ce64-4451-ae98-341d7843c73e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:15.048512 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-aacac164-ce64-4451-ae98-341d7843c73e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:15.049070 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-aacac164-ce64-4451-ae98-341d7843c73e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:15.050228 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-aacac164-ce64-4451-ae98-341d7843c73e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:15.050800 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-aacac164-ce64-4451-ae98-341d7843c73e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:15.086155 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-aacac164-ce64-4451-ae98-341d7843c73e tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052685 Jun 24 09:47:15.086959 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 348/678] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:47:15 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:15.662814 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-20741d62-e1a6-4a15-b0c7-08936051b0a0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:15.663405 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-20741d62-e1a6-4a15-b0c7-08936051b0a0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:15.670431 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-20741d62-e1a6-4a15-b0c7-08936051b0a0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:15.670878 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-20741d62-e1a6-4a15-b0c7-08936051b0a0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:15.671679 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-20741d62-e1a6-4a15-b0c7-08936051b0a0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:15.672111 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-20741d62-e1a6-4a15-b0c7-08936051b0a0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:15.805685 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-20741d62-e1a6-4a15-b0c7-08936051b0a0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:15.813379 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-20741d62-e1a6-4a15-b0c7-08936051b0a0 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1688 microversion: 2.1 time: 0.156207 Jun 24 09:47:15.814554 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 331/679] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:15 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:16.105726 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-392439a5-f9e1-47e7-9735-9279238a7f80 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:16.107148 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-392439a5-f9e1-47e7-9735-9279238a7f80 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:16.116150 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-392439a5-f9e1-47e7-9735-9279238a7f80 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:16.116592 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-392439a5-f9e1-47e7-9735-9279238a7f80 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:16.117352 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-392439a5-f9e1-47e7-9735-9279238a7f80 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:16.117776 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-392439a5-f9e1-47e7-9735-9279238a7f80 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:16.147975 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-392439a5-f9e1-47e7-9735-9279238a7f80 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049092 Jun 24 09:47:16.148530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 349/680] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:47:16 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:16.832117 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-54191fab-216f-4731-9562-a80c65688678 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:16.832762 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-54191fab-216f-4731-9562-a80c65688678 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:16.839751 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-54191fab-216f-4731-9562-a80c65688678 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:16.840140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-54191fab-216f-4731-9562-a80c65688678 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:16.840910 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-54191fab-216f-4731-9562-a80c65688678 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:16.841345 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-54191fab-216f-4731-9562-a80c65688678 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:16.982851 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-54191fab-216f-4731-9562-a80c65688678 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:16.991377 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-54191fab-216f-4731-9562-a80c65688678 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1688 microversion: 2.1 time: 0.163136 Jun 24 09:47:16.991963 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 332/681] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:16 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:17.160268 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e0e41063-9c5c-480f-955c-513a53714c58 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:17.161211 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e0e41063-9c5c-480f-955c-513a53714c58 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:17.167794 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e0e41063-9c5c-480f-955c-513a53714c58 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:17.168414 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e0e41063-9c5c-480f-955c-513a53714c58 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:17.169175 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e0e41063-9c5c-480f-955c-513a53714c58 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:17.169602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e0e41063-9c5c-480f-955c-513a53714c58 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:17.200295 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e0e41063-9c5c-480f-955c-513a53714c58 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044111 Jun 24 09:47:17.200856 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 350/682] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:47:17 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 09:47:17.260815 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-a01de4df-85e1-4657-a4df-2b0e7722346c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:17.261298 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-a01de4df-85e1-4657-a4df-2b0e7722346c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:17.268078 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a01de4df-85e1-4657-a4df-2b0e7722346c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:17.268537 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a01de4df-85e1-4657-a4df-2b0e7722346c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:17.269331 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a01de4df-85e1-4657-a4df-2b0e7722346c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:17.269741 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a01de4df-85e1-4657-a4df-2b0e7722346c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:17.298049 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-a01de4df-85e1-4657-a4df-2b0e7722346c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Going to try to terminate instance {{(pid=124338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:47:17.354749 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:17.390543 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-a01de4df-85e1-4657-a4df-2b0e7722346c tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3" status: 204 len: 0 microversion: 2.1 time: 0.133240 Jun 24 09:47:17.395379 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 333/683] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:47:17 2022] DELETE /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:47:17.400152 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-6f6811d5-fa9e-4a32-9559-faa20ff4b57f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:17.400889 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-6f6811d5-fa9e-4a32-9559-faa20ff4b57f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:17.407525 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6f6811d5-fa9e-4a32-9559-faa20ff4b57f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:17.407983 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6f6811d5-fa9e-4a32-9559-faa20ff4b57f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:17.408872 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6f6811d5-fa9e-4a32-9559-faa20ff4b57f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:17.409400 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6f6811d5-fa9e-4a32-9559-faa20ff4b57f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:17.549930 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6f6811d5-fa9e-4a32-9559-faa20ff4b57f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:17.557796 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-6f6811d5-fa9e-4a32-9559-faa20ff4b57f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3" status: 200 len: 1680 microversion: 2.1 time: 0.161780 Jun 24 09:47:17.558380 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 351/684] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:17 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:18.010290 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-0f13056d-8311-48ea-be03-11fa9cfa0d06 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:18.010979 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-0f13056d-8311-48ea-be03-11fa9cfa0d06 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:18.014718 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:18.021476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0f13056d-8311-48ea-be03-11fa9cfa0d06 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:18.022030 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0f13056d-8311-48ea-be03-11fa9cfa0d06 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:18.022978 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0f13056d-8311-48ea-be03-11fa9cfa0d06 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:18.023784 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0f13056d-8311-48ea-be03-11fa9cfa0d06 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:18.028338 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-c1568a2a-e81f-43ee-81ac-124b1d2cb3b3 req-6009214e-0455-4afe-ae03-383d6ed3023f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64", "name": "network-vif-deleted", "tag": "604c79af-8cff-4ce1-90d3-2991416e7b7f"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:47:18.037702 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-c1568a2a-e81f-43ee-81ac-124b1d2cb3b3 req-6009214e-0455-4afe-ae03-383d6ed3023f service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:18.038241 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-c1568a2a-e81f-43ee-81ac-124b1d2cb3b3 req-6009214e-0455-4afe-ae03-383d6ed3023f service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:18.052186 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-c1568a2a-e81f-43ee-81ac-124b1d2cb3b3 req-6009214e-0455-4afe-ae03-383d6ed3023f service nova] Creating event network-vif-deleted:604c79af-8cff-4ce1-90d3-2991416e7b7f for instance 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 on hv-cinder-80382 Jun 24 09:47:18.057339 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-c1568a2a-e81f-43ee-81ac-124b1d2cb3b3 req-6009214e-0455-4afe-ae03-383d6ed3023f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032697 Jun 24 09:47:18.057942 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 352/685] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:47:18.092270 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-0f13056d-8311-48ea-be03-11fa9cfa0d06 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:18.100965 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-0f13056d-8311-48ea-be03-11fa9cfa0d06 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1620 microversion: 2.1 time: 0.095258 Jun 24 09:47:18.101561 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 334/686] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:18 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1620 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:18.576613 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-06996561-1798-4fc4-b8b8-fe422e3a2680 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:18.577467 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-06996561-1798-4fc4-b8b8-fe422e3a2680 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:18.584731 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-06996561-1798-4fc4-b8b8-fe422e3a2680 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:18.585179 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-06996561-1798-4fc4-b8b8-fe422e3a2680 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:18.585955 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-06996561-1798-4fc4-b8b8-fe422e3a2680 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:18.586389 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-06996561-1798-4fc4-b8b8-fe422e3a2680 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:18.722905 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-06996561-1798-4fc4-b8b8-fe422e3a2680 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:18.732348 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-06996561-1798-4fc4-b8b8-fe422e3a2680 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3" status: 200 len: 1680 microversion: 2.1 time: 0.160417 Jun 24 09:47:18.733182 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 353/687] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:18 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:19.118302 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-eeaa36d1-5c19-4294-ad7a-05eb3fb6dee2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:19.118976 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-eeaa36d1-5c19-4294-ad7a-05eb3fb6dee2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:19.126070 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-eeaa36d1-5c19-4294-ad7a-05eb3fb6dee2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:19.126520 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-eeaa36d1-5c19-4294-ad7a-05eb3fb6dee2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:19.127365 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-eeaa36d1-5c19-4294-ad7a-05eb3fb6dee2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:19.127825 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-eeaa36d1-5c19-4294-ad7a-05eb3fb6dee2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:19.160318 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-eeaa36d1-5c19-4294-ad7a-05eb3fb6dee2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:19.160739 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-eeaa36d1-5c19-4294-ad7a-05eb3fb6dee2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:19.161216 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.objects.instance [None req-eeaa36d1-5c19-4294-ad7a-05eb3fb6dee2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lazy-loading 'fault' on Instance uuid 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 {{(pid=124338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:47:19.205560 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-eeaa36d1-5c19-4294-ad7a-05eb3fb6dee2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:19.213317 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-eeaa36d1-5c19-4294-ad7a-05eb3fb6dee2 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 200 len: 1334 microversion: 2.1 time: 0.099091 Jun 24 09:47:19.213888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 335/688] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:19 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 1334 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:19.750290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a3ff1562-2d5c-4a71-befa-7645497c6333 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:19.750899 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-a3ff1562-2d5c-4a71-befa-7645497c6333 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:19.758535 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a3ff1562-2d5c-4a71-befa-7645497c6333 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:19.758985 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a3ff1562-2d5c-4a71-befa-7645497c6333 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:19.759792 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a3ff1562-2d5c-4a71-befa-7645497c6333 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:19.760211 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a3ff1562-2d5c-4a71-befa-7645497c6333 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:19.897880 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-a3ff1562-2d5c-4a71-befa-7645497c6333 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:19.905663 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-a3ff1562-2d5c-4a71-befa-7645497c6333 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3" status: 200 len: 1680 microversion: 2.1 time: 0.159566 Jun 24 09:47:19.906200 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 354/689] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:19 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:20.152681 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-1c76d737-e023-4446-ba31-d367464a8f34 req-971d6acc-d683-4acf-be45-58ba5bffc526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e892f2df-f3bb-4a2d-8152-4bc170cff4b3", "name": "network-vif-deleted", "tag": "74e14930-4c89-4d5f-9bea-32720c272816"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:47:20.164447 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-1c76d737-e023-4446-ba31-d367464a8f34 req-971d6acc-d683-4acf-be45-58ba5bffc526 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:20.164933 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-1c76d737-e023-4446-ba31-d367464a8f34 req-971d6acc-d683-4acf-be45-58ba5bffc526 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:20.180735 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-1c76d737-e023-4446-ba31-d367464a8f34 req-971d6acc-d683-4acf-be45-58ba5bffc526 service nova] Creating event network-vif-deleted:74e14930-4c89-4d5f-9bea-32720c272816 for instance e892f2df-f3bb-4a2d-8152-4bc170cff4b3 on hv-cinder-80382 Jun 24 09:47:20.186383 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-1c76d737-e023-4446-ba31-d367464a8f34 req-971d6acc-d683-4acf-be45-58ba5bffc526 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037512 Jun 24 09:47:20.188121 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 336/690] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:20.230737 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4606e260-9602-406d-9c02-f53e0f2166d4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:20.231656 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-4606e260-9602-406d-9c02-f53e0f2166d4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:20.238768 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4606e260-9602-406d-9c02-f53e0f2166d4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:20.239851 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4606e260-9602-406d-9c02-f53e0f2166d4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:20.240636 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4606e260-9602-406d-9c02-f53e0f2166d4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:20.241063 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4606e260-9602-406d-9c02-f53e0f2166d4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:20.256782 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-4606e260-9602-406d-9c02-f53e0f2166d4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] HTTP exception thrown: Instance 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 could not be found. Jun 24 09:47:20.258546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4606e260-9602-406d-9c02-f53e0f2166d4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Request method failure captured: Jun 24 09:47:20.258546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 HTTP/1.1 Jun 24 09:47:20.258546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:47:20.258546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:47:20.258546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:47:20.258546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:47:20.258546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:47:20.258546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:47:20.258546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:47:20.258546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:47:20.258546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYbrg1PFIJaE9KsLUkvfj5MGavywSW_6-kKNWqXQtMtDM4NGVpy2qoJduFdeKzE6JHx1qIp1dD60a2_pl3EM8bMnRc1lIgF53oVZQgvtfcVbKMZo8_PxCPUz_4f9wAr5YVr6deH_wK059J2iU44YLzWTfVVv_g1WXnpsuU6S2iDXqX0 Jun 24 09:47:20.258546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:47:20.258546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:47:20.258546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:47:20.258546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:47:20.258546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:47:20.258546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:47:20.258546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 42946f76423740028ae43dc6a49cbbda Jun 24 09:47:20.258546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2069816343 Jun 24 09:47:20.258546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:47:20.258546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:47:20.260211 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_42946f76423740028ae43dc6a49cbbda", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/42946f76423740028ae43dc6a49cbbda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/42946f76423740028ae43dc6a49cbbda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/42946f76423740028ae43dc6a49cbbda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:47:20.260211 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2069816343 Jun 24 09:47:20.260211 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 42946f76423740028ae43dc6a49cbbda Jun 24 09:47:20.260211 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2069816343 Jun 24 09:47:20.260211 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-ServerRescueNegativeTestJSON-2069816343-project Jun 24 09:47:20.260211 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:47:20.260211 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:47:20.260211 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: d5e6d9fad06449c1b43254df442d224f Jun 24 09:47:20.260211 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2069816343-project Jun 24 09:47:20.260211 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:47:20.260211 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 could not be found. Jun 24 09:47:20.260211 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': '7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64'} Jun 24 09:47:20.261137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:47:20.261137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:47:20.261137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:47:20.261137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:47:20.261137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:47:20.261137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:47:20.261137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:47:20.261137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:47:20.261137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:47:20.261137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:47:20.261137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 could not be found. Jun 24 09:47:20.261137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:20.261137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:47:20.261137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:20.261137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:47:20.261137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:47:20.261137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:47:20.261137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:47:20.261137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:47:20.261137 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:47:20.262606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:47:20.262606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:47:20.262606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:47:20.262606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:47:20.262606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:47:20.262606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:47:20.262606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:47:20.262606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 could not be found. Jun 24 09:47:20.262606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:20.262606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:47:20.262606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:20.262606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:47:20.262606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:47:20.262606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:47:20.262606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:47:20.262606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:47:20.262606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 could not be found. Jun 24 09:47:20.262606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:20.263915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4606e260-9602-406d-9c02-f53e0f2166d4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Returning 404 to user: Instance 7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:47:20.263915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-4606e260-9602-406d-9c02-f53e0f2166d4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64" status: 404 len: 111 microversion: 2.1 time: 0.033320 Jun 24 09:47:20.264085 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 355/691] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:20 2022] GET /compute/v2.1/servers/7ada9ae5-70e4-4c1a-9f0f-dc258d4fdc64 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:47:20.270585 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7cae2e83-521c-4836-af86-04357b7efca4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '.version_select at 0x7fc6d49e73a0>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:20.295711 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-7cae2e83-521c-4836-af86-04357b7efca4 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-564442657" status: 202 len: 0 microversion: 2.1 time: 0.029745 Jun 24 09:47:20.296837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 337/692] 10.222.0.65 () {58 vars in 1217 bytes} [Fri Jun 24 09:47:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-564442657 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:47:20.923177 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-5e4d17d7-6313-4a5b-85c3-26c38c5db25a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:20.923891 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-5e4d17d7-6313-4a5b-85c3-26c38c5db25a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:20.930603 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5e4d17d7-6313-4a5b-85c3-26c38c5db25a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:20.931346 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5e4d17d7-6313-4a5b-85c3-26c38c5db25a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:20.933426 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5e4d17d7-6313-4a5b-85c3-26c38c5db25a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:20.934214 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5e4d17d7-6313-4a5b-85c3-26c38c5db25a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:20.949762 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-5e4d17d7-6313-4a5b-85c3-26c38c5db25a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] HTTP exception thrown: Instance e892f2df-f3bb-4a2d-8152-4bc170cff4b3 could not be found. Jun 24 09:47:20.951383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-5e4d17d7-6313-4a5b-85c3-26c38c5db25a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Request method failure captured: Jun 24 09:47:20.951383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 HTTP/1.1 Jun 24 09:47:20.951383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:47:20.951383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:47:20.951383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:47:20.951383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:47:20.951383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:47:20.951383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:47:20.951383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:47:20.951383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:47:20.951383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYbvJ3i86IfpBOV1GhbK6BjjMPGc6Tm1uaFsF_cm2jflXXzg3yQgcdVgGx8TFBVweDptNaGL-vvoreBeBGl_GS39sHCNfkE3V7sePQxiYoI7e3NRcV5C6bE6H-sdZ6Daa5bOcdZzQqk3HMpLiyCtZEkhPHZ6MJeA9vI9pz9NKdB8VSk Jun 24 09:47:20.951383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:47:20.951383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:47:20.951383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:47:20.951383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:47:20.951383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:47:20.951383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:47:20.951383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:47:20.951383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:47:20.951383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:47:20.951383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:47:20.952946 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_30033ce42b5a43b78dde38163831cea2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:47:20.952946 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:47:20.952946 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:47:20.952946 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:47:20.952946 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:47:20.952946 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:47:20.952946 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:47:20.952946 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: fd136fcda9a04a16b258301a86bde8ef Jun 24 09:47:20.952946 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:47:20.952946 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:47:20.952946 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance e892f2df-f3bb-4a2d-8152-4bc170cff4b3 could not be found. Jun 24 09:47:20.952946 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': 'e892f2df-f3bb-4a2d-8152-4bc170cff4b3'} Jun 24 09:47:20.953844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:47:20.953844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:47:20.953844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:47:20.953844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:47:20.953844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:47:20.953844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:47:20.953844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:47:20.953844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:47:20.953844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:47:20.953844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:47:20.953844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e892f2df-f3bb-4a2d-8152-4bc170cff4b3 could not be found. Jun 24 09:47:20.953844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:20.953844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:47:20.953844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:20.953844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:47:20.953844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:47:20.953844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:47:20.953844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:47:20.953844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:47:20.953844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:47:20.955357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:47:20.955357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:47:20.955357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:47:20.955357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:47:20.955357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:47:20.955357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:47:20.955357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:47:20.955357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e892f2df-f3bb-4a2d-8152-4bc170cff4b3 could not be found. Jun 24 09:47:20.955357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:20.955357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:47:20.955357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:20.955357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:47:20.955357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:47:20.955357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:47:20.955357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:47:20.955357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:47:20.955357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e892f2df-f3bb-4a2d-8152-4bc170cff4b3 could not be found. Jun 24 09:47:20.955357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:20.957531 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-5e4d17d7-6313-4a5b-85c3-26c38c5db25a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Returning 404 to user: Instance e892f2df-f3bb-4a2d-8152-4bc170cff4b3 could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:47:20.958415 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-5e4d17d7-6313-4a5b-85c3-26c38c5db25a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3" status: 404 len: 111 microversion: 2.1 time: 0.039341 Jun 24 09:47:20.962416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 356/693] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:20 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:47:20.967875 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-8da128b0-6540-4e71-96cb-1961e22762bb tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '.version_select at 0x7fc6d49ae040>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:20.991358 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-8da128b0-6540-4e71-96cb-1961e22762bb tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1439492096" status: 202 len: 0 microversion: 2.1 time: 0.027395 Jun 24 09:47:20.991955 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 338/694] 10.222.0.65 () {58 vars in 1220 bytes} [Fri Jun 24 09:47:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1439492096 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:47:21.641191 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-32918496-3e35-4ed5-9d87-a19346055f64 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Action: 'create', calling method: .version_select at 0x7fc6d43fd160>, body: {"keypair": {"name": "tempest-keypair-1020995696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIlC4ark+u2PJMDW5oXnyZgsot79EnyPZlu728RwSdV98gDjxmRadP6XS8T42E/BfkmeuBsVNnVKLaxYHLUEC/FskEB3NpfYsOIN472r54asa+JlfjBaKRXVcgfUrOSvg=="}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:47:21.655187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-32918496-3e35-4ed5-9d87-a19346055f64 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Getting quotas for project 30033ce42b5a43b78dde38163831cea2. Resources: {'key_pairs'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:47:21.658948 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-32918496-3e35-4ed5-9d87-a19346055f64 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Getting quotas for user fd136fcda9a04a16b258301a86bde8ef and project 30033ce42b5a43b78dde38163831cea2. Resources: {'key_pairs'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:47:21.683045 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-32918496-3e35-4ed5-9d87-a19346055f64 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045831 Jun 24 09:47:21.683672 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 357/695] 10.222.0.65 () {60 vars in 1158 bytes} [Fri Jun 24 09:47:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:23.002342 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-fbc6bd3a-9260-4ff2-a298-100239e14a40 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1285725394", "imageRef": "844ad823-18a2-4abc-813c-2d1825141591", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6d825bf-3025-4144-aa4c-5693ec78fffa"}], "security_groups": [{"name": "tempest-securitygroup--304862736"}], "key_name": "tempest-keypair-1020995696", "user_data": "}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:47:23.121309 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.network.neutron [None req-fbc6bd3a-9260-4ff2-a298-100239e14a40 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] validate_networks() for [('d6d825bf-3025-4144-aa4c-5693ec78fffa', None, None, None, None, None)] {{(pid=124338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:47:23.252663 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-82bb97f5-abfb-4b91-931a-25bfa397812e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:23.253457 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-82bb97f5-abfb-4b91-931a-25bfa397812e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:23.262736 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-82bb97f5-abfb-4b91-931a-25bfa397812e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:23.263432 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-82bb97f5-abfb-4b91-931a-25bfa397812e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:23.264321 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-82bb97f5-abfb-4b91-931a-25bfa397812e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:23.264749 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-82bb97f5-abfb-4b91-931a-25bfa397812e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:23.298692 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-82bb97f5-abfb-4b91-931a-25bfa397812e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Going to try to terminate instance {{(pid=124339) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:47:23.397157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-82bb97f5-abfb-4b91-931a-25bfa397812e tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "DELETE /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 204 len: 0 microversion: 2.1 time: 0.149725 Jun 24 09:47:23.398004 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 358/696] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:47:23 2022] DELETE /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:47:23.406910 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a1b23a46-24bf-4911-be80-3ab69870a2a5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:23.407948 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-a1b23a46-24bf-4911-be80-3ab69870a2a5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:23.414536 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a1b23a46-24bf-4911-be80-3ab69870a2a5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:23.414983 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a1b23a46-24bf-4911-be80-3ab69870a2a5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:23.415792 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a1b23a46-24bf-4911-be80-3ab69870a2a5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:23.416219 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a1b23a46-24bf-4911-be80-3ab69870a2a5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:23.421846 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:23.665675 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-a1b23a46-24bf-4911-be80-3ab69870a2a5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:23.675549 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-a1b23a46-24bf-4911-be80-3ab69870a2a5 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1507 microversion: 2.1 time: 0.271594 Jun 24 09:47:23.676178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 359/697] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:23 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:47:23.764513 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-fbc6bd3a-9260-4ff2-a298-100239e14a40 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Flavor limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:47:23.764972 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-fbc6bd3a-9260-4ff2-a298-100239e14a40 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Image limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:47:23.765448 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-fbc6bd3a-9260-4ff2-a298-100239e14a40 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Flavor pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:47:23.765853 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-fbc6bd3a-9260-4ff2-a298-100239e14a40 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Image pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:47:23.766260 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-fbc6bd3a-9260-4ff2-a298-100239e14a40 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:47:23.786577 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fbc6bd3a-9260-4ff2-a298-100239e14a40 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:23.787021 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fbc6bd3a-9260-4ff2-a298-100239e14a40 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:23.787843 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fbc6bd3a-9260-4ff2-a298-100239e14a40 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:23.788272 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fbc6bd3a-9260-4ff2-a298-100239e14a40 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:23.811884 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-fbc6bd3a-9260-4ff2-a298-100239e14a40 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Getting quotas for project 30033ce42b5a43b78dde38163831cea2. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:47:23.816283 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-fbc6bd3a-9260-4ff2-a298-100239e14a40 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Getting quotas for user fd136fcda9a04a16b258301a86bde8ef and project 30033ce42b5a43b78dde38163831cea2. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:47:23.831628 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-fbc6bd3a-9260-4ff2-a298-100239e14a40 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Going to run 1 instances... {{(pid=124338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:47:23.834505 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-fbc6bd3a-9260-4ff2-a298-100239e14a40 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='844ad823-18a2-4abc-813c-2d1825141591',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:47:23.889565 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-fbc6bd3a-9260-4ff2-a298-100239e14a40 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.891407 Jun 24 09:47:23.890368 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 339/698] 10.222.0.65 () {60 vars in 1146 bytes} [Fri Jun 24 09:47:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 09:47:23.906786 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-d6a04ea5-7cb8-4f08-b619-f35ff3935c08 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:23.907682 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-d6a04ea5-7cb8-4f08-b619-f35ff3935c08 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:23.962608 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-d6a04ea5-7cb8-4f08-b619-f35ff3935c08 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:23.969389 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-d6a04ea5-7cb8-4f08-b619-f35ff3935c08 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb" status: 200 len: 1242 microversion: 2.1 time: 0.066665 Jun 24 09:47:23.970245 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 360/699] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:23 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:24.697582 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ddf6ab2f-de50-40dd-ae08-4b88bf814445 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:24.698582 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ddf6ab2f-de50-40dd-ae08-4b88bf814445 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:24.709161 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ddf6ab2f-de50-40dd-ae08-4b88bf814445 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:24.709834 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ddf6ab2f-de50-40dd-ae08-4b88bf814445 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:24.711045 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ddf6ab2f-de50-40dd-ae08-4b88bf814445 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:24.711738 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ddf6ab2f-de50-40dd-ae08-4b88bf814445 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:24.852922 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ddf6ab2f-de50-40dd-ae08-4b88bf814445 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:24.864746 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ddf6ab2f-de50-40dd-ae08-4b88bf814445 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1507 microversion: 2.1 time: 0.172617 Jun 24 09:47:24.865480 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 340/700] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:24 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:24.988430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-68876011-0d6d-41bb-a87e-d07f0b6e02d3 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:24.989042 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-68876011-0d6d-41bb-a87e-d07f0b6e02d3 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:24.997011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-68876011-0d6d-41bb-a87e-d07f0b6e02d3 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:24.997456 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-68876011-0d6d-41bb-a87e-d07f0b6e02d3 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:24.998261 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-68876011-0d6d-41bb-a87e-d07f0b6e02d3 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:24.998704 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-68876011-0d6d-41bb-a87e-d07f0b6e02d3 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:25.072583 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-68876011-0d6d-41bb-a87e-d07f0b6e02d3 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:25.080486 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-68876011-0d6d-41bb-a87e-d07f0b6e02d3 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb" status: 200 len: 1246 microversion: 2.1 time: 0.096649 Jun 24 09:47:25.081127 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 361/701] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:24 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb => generated 1246 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:25.393127 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7343c9cd-7ab9-459d-87cf-75468d7aea6b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2007842856"}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:47:25.393677 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-7343c9cd-7ab9-459d-87cf-75468d7aea6b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:25.400562 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7343c9cd-7ab9-459d-87cf-75468d7aea6b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:25.401028 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7343c9cd-7ab9-459d-87cf-75468d7aea6b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:25.401810 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7343c9cd-7ab9-459d-87cf-75468d7aea6b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:25.402251 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7343c9cd-7ab9-459d-87cf-75468d7aea6b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:25.556154 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.network.security_group_api [None req-7343c9cd-7ab9-459d-87cf-75468d7aea6b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Removing security group 309ce118-b51a-42e5-b315-1f2652eb254c from port de309464-eb94-4c38-b29b-c293a12d68b1 Jun 24 09:47:25.883461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e50f3d13-08ce-4b45-85a9-9f2ac5eef12a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:25.884380 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e50f3d13-08ce-4b45-85a9-9f2ac5eef12a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:25.896292 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e50f3d13-08ce-4b45-85a9-9f2ac5eef12a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:25.896661 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e50f3d13-08ce-4b45-85a9-9f2ac5eef12a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:25.897439 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e50f3d13-08ce-4b45-85a9-9f2ac5eef12a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:25.897870 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e50f3d13-08ce-4b45-85a9-9f2ac5eef12a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:25.935771 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-7343c9cd-7ab9-459d-87cf-75468d7aea6b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "POST /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/action" status: 202 len: 0 microversion: 2.1 time: 0.546715 Jun 24 09:47:25.936406 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 341/702] 10.222.0.65 () {60 vars in 1277 bytes} [Fri Jun 24 09:47:25 2022] POST /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/action => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:47:26.117027 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-25a1295e-81db-46e4-a66b-0747f3a73351 req-35c70152-0d08-435b-95c1-a38ae9381e7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d874254-475b-4025-8b67-b4af897fdb60", "tag": "de309464-eb94-4c38-b29b-c293a12d68b1"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:47:26.137435 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-25a1295e-81db-46e4-a66b-0747f3a73351 req-35c70152-0d08-435b-95c1-a38ae9381e7a service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:26.138648 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-25a1295e-81db-46e4-a66b-0747f3a73351 req-35c70152-0d08-435b-95c1-a38ae9381e7a service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:26.170507 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-25a1295e-81db-46e4-a66b-0747f3a73351 req-35c70152-0d08-435b-95c1-a38ae9381e7a service nova] Creating event network-changed:de309464-eb94-4c38-b29b-c293a12d68b1 for instance 0d874254-475b-4025-8b67-b4af897fdb60 on hv-cinder-80382 Jun 24 09:47:26.184817 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-25a1295e-81db-46e4-a66b-0747f3a73351 req-35c70152-0d08-435b-95c1-a38ae9381e7a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233295 Jun 24 09:47:26.187104 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 342/703] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:47:26.198190 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7e72874c-2cf0-430a-a8ec-ec9b18261a63 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:26.198878 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-7e72874c-2cf0-430a-a8ec-ec9b18261a63 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:26.208939 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7e72874c-2cf0-430a-a8ec-ec9b18261a63 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:26.209848 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7e72874c-2cf0-430a-a8ec-ec9b18261a63 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:26.211517 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7e72874c-2cf0-430a-a8ec-ec9b18261a63 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:26.212057 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7e72874c-2cf0-430a-a8ec-ec9b18261a63 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:26.547799 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-7e72874c-2cf0-430a-a8ec-ec9b18261a63 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:26.556287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-7e72874c-2cf0-430a-a8ec-ec9b18261a63 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb" status: 200 len: 1302 microversion: 2.1 time: 0.364216 Jun 24 09:47:26.559609 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e50f3d13-08ce-4b45-85a9-9f2ac5eef12a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:26.566173 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 343/704] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:26 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb => generated 1302 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:26.570091 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e50f3d13-08ce-4b45-85a9-9f2ac5eef12a tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 200 len: 1507 microversion: 2.1 time: 0.690977 Jun 24 09:47:26.580126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 362/705] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:25 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 1507 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:47:26.668859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-80350e7a-902e-4932-92ed-6d3c08d4cc0d req-839064d8-84ec-4620-b480-5eee984fcd0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bebb7ab7-cad1-4e94-aedd-5852d76b5f3c", "name": "network-vif-deleted", "tag": "ccbac6d6-252a-4188-b391-a975bc7720c2"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:47:26.702316 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-80350e7a-902e-4932-92ed-6d3c08d4cc0d req-839064d8-84ec-4620-b480-5eee984fcd0c service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:26.703193 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-80350e7a-902e-4932-92ed-6d3c08d4cc0d req-839064d8-84ec-4620-b480-5eee984fcd0c service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:26.719196 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-80350e7a-902e-4932-92ed-6d3c08d4cc0d req-839064d8-84ec-4620-b480-5eee984fcd0c service nova] Creating event network-vif-deleted:ccbac6d6-252a-4188-b391-a975bc7720c2 for instance bebb7ab7-cad1-4e94-aedd-5852d76b5f3c on hv-cinder-80382 Jun 24 09:47:26.737063 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-80350e7a-902e-4932-92ed-6d3c08d4cc0d req-839064d8-84ec-4620-b480-5eee984fcd0c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071599 Jun 24 09:47:26.737867 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 344/706] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:27.574159 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-dcd64311-35d8-4205-849a-893867852743 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:27.576242 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-dcd64311-35d8-4205-849a-893867852743 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:27.586333 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dcd64311-35d8-4205-849a-893867852743 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:27.586973 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dcd64311-35d8-4205-849a-893867852743 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:27.587944 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dcd64311-35d8-4205-849a-893867852743 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:27.588523 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dcd64311-35d8-4205-849a-893867852743 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:27.589266 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-361cfc23-2ac8-4a0b-8838-494eb3a9db77 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:27.590081 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-361cfc23-2ac8-4a0b-8838-494eb3a9db77 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: bebb7ab7-cad1-4e94-aedd-5852d76b5f3c] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:27.599691 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-361cfc23-2ac8-4a0b-8838-494eb3a9db77 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:27.600546 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-361cfc23-2ac8-4a0b-8838-494eb3a9db77 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:27.601813 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-361cfc23-2ac8-4a0b-8838-494eb3a9db77 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:27.602466 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-361cfc23-2ac8-4a0b-8838-494eb3a9db77 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:27.620114 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.wsgi [None req-361cfc23-2ac8-4a0b-8838-494eb3a9db77 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] HTTP exception thrown: Instance bebb7ab7-cad1-4e94-aedd-5852d76b5f3c could not be found. Jun 24 09:47:27.622983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-361cfc23-2ac8-4a0b-8838-494eb3a9db77 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Request method failure captured: Jun 24 09:47:27.622983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c HTTP/1.1 Jun 24 09:47:27.622983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:47:27.622983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:47:27.622983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:47:27.622983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 0 Jun 24 09:47:27.622983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:47:27.622983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:47:27.622983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:47:27.622983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:47:27.622983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYbrg1PFIJaE9KsLUkvfj5MGavywSW_6-kKNWqXQtMtDM4NGVpy2qoJduFdeKzE6JHx1qIp1dD60a2_pl3EM8bMnRc1lIgF53oVZQgvtfcVbKMZo8_PxCPUz_4f9wAr5YVr6deH_wK059J2iU44YLzWTfVVv_g1WXnpsuU6S2iDXqX0 Jun 24 09:47:27.622983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:47:27.622983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:47:27.622983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:47:27.622983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:47:27.622983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:47:27.622983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:47:27.622983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: 42946f76423740028ae43dc6a49cbbda Jun 24 09:47:27.622983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2069816343 Jun 24 09:47:27.622983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:47:27.622983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:47:27.624300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_42946f76423740028ae43dc6a49cbbda", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/42946f76423740028ae43dc6a49cbbda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/42946f76423740028ae43dc6a49cbbda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/42946f76423740028ae43dc6a49cbbda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:47:27.624300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2069816343 Jun 24 09:47:27.624300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: 42946f76423740028ae43dc6a49cbbda Jun 24 09:47:27.624300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2069816343 Jun 24 09:47:27.624300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-ServerRescueNegativeTestJSON-2069816343-project Jun 24 09:47:27.624300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:47:27.624300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:47:27.624300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: d5e6d9fad06449c1b43254df442d224f Jun 24 09:47:27.624300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2069816343-project Jun 24 09:47:27.624300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: > Jun 24 09:47:27.624300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Instance bebb7ab7-cad1-4e94-aedd-5852d76b5f3c could not be found. Jun 24 09:47:27.624300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'id': 'bebb7ab7-cad1-4e94-aedd-5852d76b5f3c'} Jun 24 09:47:27.625188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:47:27.625188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:47:27.625188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:47:27.625188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:47:27.625188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:47:27.625188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:47:27.625188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:47:27.625188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:47:27.625188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:47:27.625188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:47:27.625188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bebb7ab7-cad1-4e94-aedd-5852d76b5f3c could not be found. Jun 24 09:47:27.625188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:47:27.625188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:47:27.625188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:47:27.625188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:47:27.625188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:47:27.625188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:47:27.625188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:47:27.625188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:47:27.625188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:47:27.626825 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:47:27.626825 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:47:27.626825 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:47:27.626825 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:47:27.626825 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:47:27.626825 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:47:27.626825 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:47:27.626825 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bebb7ab7-cad1-4e94-aedd-5852d76b5f3c could not be found. Jun 24 09:47:27.626825 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:47:27.626825 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:47:27.626825 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:47:27.626825 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:47:27.626825 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:47:27.626825 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:47:27.626825 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:47:27.626825 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:47:27.626825 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bebb7ab7-cad1-4e94-aedd-5852d76b5f3c could not be found. Jun 24 09:47:27.626825 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:47:27.634771 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-361cfc23-2ac8-4a0b-8838-494eb3a9db77 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Returning 404 to user: Instance bebb7ab7-cad1-4e94-aedd-5852d76b5f3c could not be found. {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:47:27.636239 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-361cfc23-2ac8-4a0b-8838-494eb3a9db77 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c" status: 404 len: 111 microversion: 2.1 time: 0.052909 Jun 24 09:47:27.637530 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 345/707] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:27 2022] GET /compute/v2.1/servers/bebb7ab7-cad1-4e94-aedd-5852d76b5f3c => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:47:27.646448 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-895941a8-a500-43d4-ba15-761956369b67 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:27.647287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-895941a8-a500-43d4-ba15-761956369b67 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:27.653654 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-895941a8-a500-43d4-ba15-761956369b67 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:27.654353 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-895941a8-a500-43d4-ba15-761956369b67 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:27.655282 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-895941a8-a500-43d4-ba15-761956369b67 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:27.655790 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-895941a8-a500-43d4-ba15-761956369b67 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:27.683717 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-895941a8-a500-43d4-ba15-761956369b67 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Going to try to terminate instance {{(pid=124338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:47:27.702869 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-dcd64311-35d8-4205-849a-893867852743 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:27.710359 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-dcd64311-35d8-4205-849a-893867852743 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb" status: 200 len: 1300 microversion: 2.1 time: 0.140556 Jun 24 09:47:27.710964 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 363/708] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:27 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb => generated 1300 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:27.767470 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-58d55bce-58c4-4877-9d34-9fb859bc5c6c tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:27.769333 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-58d55bce-58c4-4877-9d34-9fb859bc5c6c tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:27.776613 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-58d55bce-58c4-4877-9d34-9fb859bc5c6c tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:27.777424 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-58d55bce-58c4-4877-9d34-9fb859bc5c6c tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:27.778444 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-58d55bce-58c4-4877-9d34-9fb859bc5c6c tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:27.779281 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-58d55bce-58c4-4877-9d34-9fb859bc5c6c tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:27.818677 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-895941a8-a500-43d4-ba15-761956369b67 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 204 len: 0 microversion: 2.1 time: 0.176082 Jun 24 09:47:27.821995 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 346/709] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:47:27 2022] DELETE /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 09:47:27.831059 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-32d73d02-e947-4b48-808f-82b46d5486fa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:27.832027 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-32d73d02-e947-4b48-808f-82b46d5486fa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:27.840553 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-32d73d02-e947-4b48-808f-82b46d5486fa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:27.841077 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-32d73d02-e947-4b48-808f-82b46d5486fa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:27.841794 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-32d73d02-e947-4b48-808f-82b46d5486fa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:27.842524 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-32d73d02-e947-4b48-808f-82b46d5486fa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:27.969538 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.objects.instance [None req-58d55bce-58c4-4877-9d34-9fb859bc5c6c tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lazy-loading 'services' on Instance uuid 0d874254-475b-4025-8b67-b4af897fdb60 {{(pid=124339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:47:28.074289 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-32d73d02-e947-4b48-808f-82b46d5486fa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:28.084581 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-32d73d02-e947-4b48-808f-82b46d5486fa tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1521 microversion: 2.1 time: 0.260363 Jun 24 09:47:28.085596 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 347/710] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:27 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:28.142345 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-58d55bce-58c4-4877-9d34-9fb859bc5c6c tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/os-volume_attachments/ff169ce7-4266-4222-838f-821ec0b4e651" status: 202 len: 0 microversion: 2.1 time: 0.378546 Jun 24 09:47:28.143681 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 364/711] 10.222.0.65 () {58 vars in 1415 bytes} [Fri Jun 24 09:47:27 2022] DELETE /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/os-volume_attachments/ff169ce7-4266-4222-838f-821ec0b4e651 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:47:28.153870 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-4423154f-4852-42e2-b943-85d4a72a9fad tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:28.153870 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-4423154f-4852-42e2-b943-85d4a72a9fad tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:28.160210 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-4423154f-4852-42e2-b943-85d4a72a9fad tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:28.160970 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-4423154f-4852-42e2-b943-85d4a72a9fad tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:28.161852 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-4423154f-4852-42e2-b943-85d4a72a9fad tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:28.162383 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-4423154f-4852-42e2-b943-85d4a72a9fad tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:28.193710 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-4423154f-4852-42e2-b943-85d4a72a9fad tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045715 Jun 24 09:47:28.194400 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 348/712] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:47:28 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:47:28.729279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f2095017-ad56-488a-8c60-635c458f1cd2 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:28.729990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-f2095017-ad56-488a-8c60-635c458f1cd2 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:28.737796 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f2095017-ad56-488a-8c60-635c458f1cd2 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:28.738249 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f2095017-ad56-488a-8c60-635c458f1cd2 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:28.739043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f2095017-ad56-488a-8c60-635c458f1cd2 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:28.739517 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f2095017-ad56-488a-8c60-635c458f1cd2 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:28.755061 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-387180c3-e130-43d6-99dc-d8d1d2f8bd02 req-383be740-261e-47ba-a858-38d3d6bb8bbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d874254-475b-4025-8b67-b4af897fdb60", "tag": "de309464-eb94-4c38-b29b-c293a12d68b1"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:47:28.768856 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-387180c3-e130-43d6-99dc-d8d1d2f8bd02 req-383be740-261e-47ba-a858-38d3d6bb8bbf service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:28.769665 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-387180c3-e130-43d6-99dc-d8d1d2f8bd02 req-383be740-261e-47ba-a858-38d3d6bb8bbf service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:28.782362 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-387180c3-e130-43d6-99dc-d8d1d2f8bd02 req-383be740-261e-47ba-a858-38d3d6bb8bbf service nova] Creating event network-changed:de309464-eb94-4c38-b29b-c293a12d68b1 for instance 0d874254-475b-4025-8b67-b4af897fdb60 on hv-cinder-80382 Jun 24 09:47:28.788189 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-387180c3-e130-43d6-99dc-d8d1d2f8bd02 req-383be740-261e-47ba-a858-38d3d6bb8bbf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037088 Jun 24 09:47:28.789176 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 349/713] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:28.894425 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-f2095017-ad56-488a-8c60-635c458f1cd2 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:28.902343 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f2095017-ad56-488a-8c60-635c458f1cd2 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb" status: 200 len: 1367 microversion: 2.1 time: 0.177426 Jun 24 09:47:28.902937 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 365/714] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:28 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:29.107270 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-41687500-1543-441a-8ac9-e0358527e267 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:29.108294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-41687500-1543-441a-8ac9-e0358527e267 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:29.119162 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-41687500-1543-441a-8ac9-e0358527e267 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:29.120125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-41687500-1543-441a-8ac9-e0358527e267 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:29.121556 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-41687500-1543-441a-8ac9-e0358527e267 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:29.122301 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-41687500-1543-441a-8ac9-e0358527e267 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:29.206593 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-d534c4c0-7371-4f37-97db-320dd7f940bc tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:29.207628 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-d534c4c0-7371-4f37-97db-320dd7f940bc tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:29.213834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d534c4c0-7371-4f37-97db-320dd7f940bc tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:29.214288 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d534c4c0-7371-4f37-97db-320dd7f940bc tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:29.215060 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d534c4c0-7371-4f37-97db-320dd7f940bc tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:29.215609 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d534c4c0-7371-4f37-97db-320dd7f940bc tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:29.247125 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-d534c4c0-7371-4f37-97db-320dd7f940bc tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044500 Jun 24 09:47:29.247701 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 366/715] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:47:29 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:29.276293 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-41687500-1543-441a-8ac9-e0358527e267 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:29.286506 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-41687500-1543-441a-8ac9-e0358527e267 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1521 microversion: 2.1 time: 0.186616 Jun 24 09:47:29.287051 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 350/716] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:29 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:29.923807 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1206dc39-bb76-4562-a16c-b9e0698d0775 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:29.925784 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-1206dc39-bb76-4562-a16c-b9e0698d0775 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:29.936929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1206dc39-bb76-4562-a16c-b9e0698d0775 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:29.937675 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1206dc39-bb76-4562-a16c-b9e0698d0775 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:29.938939 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1206dc39-bb76-4562-a16c-b9e0698d0775 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:29.939737 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1206dc39-bb76-4562-a16c-b9e0698d0775 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:30.094974 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-1206dc39-bb76-4562-a16c-b9e0698d0775 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:30.103934 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-1206dc39-bb76-4562-a16c-b9e0698d0775 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb" status: 200 len: 1367 microversion: 2.1 time: 0.186585 Jun 24 09:47:30.104510 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 367/717] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:29 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:30.259322 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-9388337a-5662-40c2-8309-4614c3028c9a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:30.260287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-9388337a-5662-40c2-8309-4614c3028c9a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:30.267423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9388337a-5662-40c2-8309-4614c3028c9a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:30.268444 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9388337a-5662-40c2-8309-4614c3028c9a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:30.269231 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9388337a-5662-40c2-8309-4614c3028c9a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:30.269661 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9388337a-5662-40c2-8309-4614c3028c9a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:30.302617 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-9388337a-5662-40c2-8309-4614c3028c9a tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047210 Jun 24 09:47:30.303116 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 351/718] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:47:30 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:30.304714 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-cee95155-7b18-4c22-a3ee-b88ec4eb401d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:30.305361 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-cee95155-7b18-4c22-a3ee-b88ec4eb401d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:30.311966 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-cee95155-7b18-4c22-a3ee-b88ec4eb401d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:30.312416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-cee95155-7b18-4c22-a3ee-b88ec4eb401d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:30.313190 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-cee95155-7b18-4c22-a3ee-b88ec4eb401d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:30.313620 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-cee95155-7b18-4c22-a3ee-b88ec4eb401d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:30.444321 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-cee95155-7b18-4c22-a3ee-b88ec4eb401d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:30.452269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-cee95155-7b18-4c22-a3ee-b88ec4eb401d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1521 microversion: 2.1 time: 0.151452 Jun 24 09:47:30.452843 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 368/719] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:30 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:31.121104 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-1f647b8f-0491-4e87-9f6c-96502a717bcf tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:31.121816 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-1f647b8f-0491-4e87-9f6c-96502a717bcf tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:31.128720 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1f647b8f-0491-4e87-9f6c-96502a717bcf tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:31.129262 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1f647b8f-0491-4e87-9f6c-96502a717bcf tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:31.130126 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1f647b8f-0491-4e87-9f6c-96502a717bcf tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:31.130681 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1f647b8f-0491-4e87-9f6c-96502a717bcf tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:31.315692 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-424c4ae2-a28f-4a7e-bb65-b6f28ef00d70 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:31.317252 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-424c4ae2-a28f-4a7e-bb65-b6f28ef00d70 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:31.319816 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:31.333643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-424c4ae2-a28f-4a7e-bb65-b6f28ef00d70 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:31.334821 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-424c4ae2-a28f-4a7e-bb65-b6f28ef00d70 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:31.335970 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-424c4ae2-a28f-4a7e-bb65-b6f28ef00d70 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:31.338369 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-424c4ae2-a28f-4a7e-bb65-b6f28ef00d70 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:31.386567 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-424c4ae2-a28f-4a7e-bb65-b6f28ef00d70 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075563 Jun 24 09:47:31.387543 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 369/720] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:47:31 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:31.471147 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-82fe188a-f0aa-4aeb-bf20-964a1712e954 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:31.472298 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-82fe188a-f0aa-4aeb-bf20-964a1712e954 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:31.486645 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-82fe188a-f0aa-4aeb-bf20-964a1712e954 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:31.487440 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-82fe188a-f0aa-4aeb-bf20-964a1712e954 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:31.488707 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-82fe188a-f0aa-4aeb-bf20-964a1712e954 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:31.489212 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-82fe188a-f0aa-4aeb-bf20-964a1712e954 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:31.617254 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-1f647b8f-0491-4e87-9f6c-96502a717bcf tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:31.630379 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-1f647b8f-0491-4e87-9f6c-96502a717bcf tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb" status: 200 len: 1367 microversion: 2.1 time: 0.513082 Jun 24 09:47:31.631640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 352/721] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:31 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb => generated 1367 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:31.831722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-7c7f2254-05fa-4e9b-b92d-c9d21ad019e4 req-e4fa2c49-c22f-476e-901f-f31b55a630e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2135f6c7-0718-46fa-94a8-f948e487e37f", "name": "network-vif-deleted", "tag": "70b66b36-bc61-4e7d-8b33-ed840e49fe68"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:47:31.843738 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-7c7f2254-05fa-4e9b-b92d-c9d21ad019e4 req-e4fa2c49-c22f-476e-901f-f31b55a630e8 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:31.844171 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-7c7f2254-05fa-4e9b-b92d-c9d21ad019e4 req-e4fa2c49-c22f-476e-901f-f31b55a630e8 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:31.848380 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-82fe188a-f0aa-4aeb-bf20-964a1712e954 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e6d9fad06449c1b43254df442d224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42946f76423740028ae43dc6a49cbbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:31.860360 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-82fe188a-f0aa-4aeb-bf20-964a1712e954 tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 200 len: 1521 microversion: 2.1 time: 0.394257 Jun 24 09:47:31.861541 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 370/722] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:31 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:31.873300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-7c7f2254-05fa-4e9b-b92d-c9d21ad019e4 req-e4fa2c49-c22f-476e-901f-f31b55a630e8 service nova] Creating event network-vif-deleted:70b66b36-bc61-4e7d-8b33-ed840e49fe68 for instance 2135f6c7-0718-46fa-94a8-f948e487e37f on hv-cinder-80382 Jun 24 09:47:31.883803 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-7c7f2254-05fa-4e9b-b92d-c9d21ad019e4 req-e4fa2c49-c22f-476e-901f-f31b55a630e8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126144 Jun 24 09:47:31.884696 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 353/723] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:31.888405 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-ec1357ca-a25d-42aa-80b3-3c4795a002b7 req-7daad4dd-ae1d-4aa3-a282-9e971a433986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ad568e-23cd-4785-ac2f-89601b02e8cb", "tag": "a767a0b3-c7d0-4fd0-895f-6d471a89e711"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:47:31.915597 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-ec1357ca-a25d-42aa-80b3-3c4795a002b7 req-7daad4dd-ae1d-4aa3-a282-9e971a433986 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:31.916044 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-ec1357ca-a25d-42aa-80b3-3c4795a002b7 req-7daad4dd-ae1d-4aa3-a282-9e971a433986 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:31.933175 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-ec1357ca-a25d-42aa-80b3-3c4795a002b7 req-7daad4dd-ae1d-4aa3-a282-9e971a433986 service nova] Creating event network-changed:a767a0b3-c7d0-4fd0-895f-6d471a89e711 for instance 21ad568e-23cd-4785-ac2f-89601b02e8cb on hv-cinder-80382 Jun 24 09:47:31.939295 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-ec1357ca-a25d-42aa-80b3-3c4795a002b7 req-7daad4dd-ae1d-4aa3-a282-9e971a433986 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066539 Jun 24 09:47:31.940175 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 371/724] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:47:32.399579 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-8d48a7fb-e5b6-440a-b25b-0648802666d1 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:32.400757 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-8d48a7fb-e5b6-440a-b25b-0648802666d1 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:32.407097 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8d48a7fb-e5b6-440a-b25b-0648802666d1 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:32.407559 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8d48a7fb-e5b6-440a-b25b-0648802666d1 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:32.408360 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8d48a7fb-e5b6-440a-b25b-0648802666d1 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:32.408791 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8d48a7fb-e5b6-440a-b25b-0648802666d1 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:32.438162 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-8d48a7fb-e5b6-440a-b25b-0648802666d1 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043649 Jun 24 09:47:32.438745 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 354/725] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:47:32 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 09:47:32.450299 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-2526135e-c739-4a71-abcd-764b83e556fd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:32.450899 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-2526135e-c739-4a71-abcd-764b83e556fd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:32.457653 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2526135e-c739-4a71-abcd-764b83e556fd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:32.458096 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2526135e-c739-4a71-abcd-764b83e556fd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:32.458859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2526135e-c739-4a71-abcd-764b83e556fd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:32.459324 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2526135e-c739-4a71-abcd-764b83e556fd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:32.537529 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-2526135e-c739-4a71-abcd-764b83e556fd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] HTTP exception thrown: Instance 0d874254-475b-4025-8b67-b4af897fdb60 is not attached to volume ff169ce7-4266-4222-838f-821ec0b4e651 Jun 24 09:47:32.539919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-2526135e-c739-4a71-abcd-764b83e556fd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Request method failure captured: Jun 24 09:47:32.539919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: DELETE /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/os-volume_attachments/ff169ce7-4266-4222-838f-821ec0b4e651 HTTP/1.1 Jun 24 09:47:32.539919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:47:32.539919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:47:32.539919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:47:32.539919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:47:32.539919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:47:32.539919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:47:32.539919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:47:32.539919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:47:32.539919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYeOn6TLL2BrdIZn-U5QaGmgX7ouMj7ppQ0wX3x_CYbFjA_miTAMoM9Nz3hrXqPCj3jVM506El9fBVcK6hV2D-TiQMas5tAFUlx0e2qWvyg-hRXWgug2C6WOlufkn__j0px1Kq74_rlILLxN9aVM3Yu3XL-cNop0Jt1tUy8UJicb3-4 Jun 24 09:47:32.539919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:47:32.539919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:47:32.539919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:47:32.539919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:47:32.539919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:47:32.539919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:47:32.539919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: a0aff51028ec477ebbc12e078174977a Jun 24 09:47:32.539919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-TestMinimumBasicScenario-1606186572 Jun 24 09:47:32.539919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:47:32.539919 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:47:32.541396 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a0aff51028ec477ebbc12e078174977a", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a0aff51028ec477ebbc12e078174977a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a0aff51028ec477ebbc12e078174977a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a0aff51028ec477ebbc12e078174977a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:47:32.541396 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-TestMinimumBasicScenario-1606186572 Jun 24 09:47:32.541396 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: a0aff51028ec477ebbc12e078174977a Jun 24 09:47:32.541396 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1606186572 Jun 24 09:47:32.541396 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-TestMinimumBasicScenario-1606186572-project Jun 24 09:47:32.541396 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:47:32.541396 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:47:32.541396 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: 1636311c73b9461c9a64db18e8fdf0a3 Jun 24 09:47:32.541396 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-TestMinimumBasicScenario-1606186572-project Jun 24 09:47:32.541396 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:47:32.541396 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance 0d874254-475b-4025-8b67-b4af897fdb60 is not attached to volume ff169ce7-4266-4222-838f-821ec0b4e651 Jun 24 09:47:32.542135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'server_id': '0d874254-475b-4025-8b67-b4af897fdb60', 'id': 'ff169ce7-4266-4222-838f-821ec0b4e651'} Jun 24 09:47:32.542135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:47:32.542135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:47:32.542135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 24 09:47:32.542135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 24 09:47:32.542135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 09:47:32.542135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 09:47:32.542135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 24 09:47:32.542135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 24 09:47:32.542135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ff169ce7-4266-4222-838f-821ec0b4e651. Jun 24 09:47:32.542135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:32.542135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:47:32.542135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:32.542135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:47:32.542135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:47:32.542135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:47:32.542135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:47:32.542135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:47:32.542135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:47:32.543430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:47:32.543430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 24 09:47:32.543430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 24 09:47:32.543430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d874254-475b-4025-8b67-b4af897fdb60 is not attached to volume ff169ce7-4266-4222-838f-821ec0b4e651 Jun 24 09:47:32.543430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:32.543430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:47:32.543430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:32.543430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:47:32.543430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:47:32.543430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:47:32.543430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:47:32.543430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:47:32.543430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d874254-475b-4025-8b67-b4af897fdb60 is not attached to volume ff169ce7-4266-4222-838f-821ec0b4e651 Jun 24 09:47:32.543430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:32.543430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-2526135e-c739-4a71-abcd-764b83e556fd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Returning 404 to user: Instance 0d874254-475b-4025-8b67-b4af897fdb60 is not attached to volume ff169ce7-4266-4222-838f-821ec0b4e651 {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:47:32.544739 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-2526135e-c739-4a71-abcd-764b83e556fd tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/os-volume_attachments/ff169ce7-4266-4222-838f-821ec0b4e651" status: 404 len: 154 microversion: 2.1 time: 0.096019 Jun 24 09:47:32.544739 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 372/726] 10.222.0.65 () {58 vars in 1415 bytes} [Fri Jun 24 09:47:32 2022] DELETE /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60/os-volume_attachments/ff169ce7-4266-4222-838f-821ec0b4e651 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:47:32.648526 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-0dcaa2f0-d86f-477b-a413-bdca08a62d87 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:32.649154 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-0dcaa2f0-d86f-477b-a413-bdca08a62d87 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:32.657417 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0dcaa2f0-d86f-477b-a413-bdca08a62d87 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:32.658003 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0dcaa2f0-d86f-477b-a413-bdca08a62d87 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:32.659187 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0dcaa2f0-d86f-477b-a413-bdca08a62d87 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:32.659740 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0dcaa2f0-d86f-477b-a413-bdca08a62d87 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:32.683253 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:32.807859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-0dcaa2f0-d86f-477b-a413-bdca08a62d87 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:32.816785 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-0dcaa2f0-d86f-477b-a413-bdca08a62d87 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb" status: 200 len: 1367 microversion: 2.1 time: 0.173052 Jun 24 09:47:32.817578 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 355/727] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:32 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:32.878125 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-eea44dc8-f1f6-4bff-b949-734749767c8d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:32.878769 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-eea44dc8-f1f6-4bff-b949-734749767c8d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] [instance: 2135f6c7-0718-46fa-94a8-f948e487e37f] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:32.884970 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eea44dc8-f1f6-4bff-b949-734749767c8d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:32.885424 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eea44dc8-f1f6-4bff-b949-734749767c8d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:32.886183 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eea44dc8-f1f6-4bff-b949-734749767c8d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:32.886618 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eea44dc8-f1f6-4bff-b949-734749767c8d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:32.900093 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-eea44dc8-f1f6-4bff-b949-734749767c8d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] HTTP exception thrown: Instance 2135f6c7-0718-46fa-94a8-f948e487e37f could not be found. Jun 24 09:47:32.901637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-eea44dc8-f1f6-4bff-b949-734749767c8d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Request method failure captured: Jun 24 09:47:32.901637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f HTTP/1.1 Jun 24 09:47:32.901637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:47:32.901637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:47:32.901637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:47:32.901637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:47:32.901637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:47:32.901637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:47:32.901637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:47:32.901637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:47:32.901637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYbrg1PFIJaE9KsLUkvfj5MGavywSW_6-kKNWqXQtMtDM4NGVpy2qoJduFdeKzE6JHx1qIp1dD60a2_pl3EM8bMnRc1lIgF53oVZQgvtfcVbKMZo8_PxCPUz_4f9wAr5YVr6deH_wK059J2iU44YLzWTfVVv_g1WXnpsuU6S2iDXqX0 Jun 24 09:47:32.901637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:47:32.901637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:47:32.901637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:47:32.901637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:47:32.901637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:47:32.901637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:47:32.901637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 42946f76423740028ae43dc6a49cbbda Jun 24 09:47:32.901637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2069816343 Jun 24 09:47:32.901637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:47:32.901637 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:47:32.903207 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_42946f76423740028ae43dc6a49cbbda", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/42946f76423740028ae43dc6a49cbbda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/42946f76423740028ae43dc6a49cbbda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/42946f76423740028ae43dc6a49cbbda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:47:32.903207 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2069816343 Jun 24 09:47:32.903207 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 42946f76423740028ae43dc6a49cbbda Jun 24 09:47:32.903207 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2069816343 Jun 24 09:47:32.903207 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-ServerRescueNegativeTestJSON-2069816343-project Jun 24 09:47:32.903207 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:47:32.903207 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:47:32.903207 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: d5e6d9fad06449c1b43254df442d224f Jun 24 09:47:32.903207 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2069816343-project Jun 24 09:47:32.903207 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:47:32.903207 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance 2135f6c7-0718-46fa-94a8-f948e487e37f could not be found. Jun 24 09:47:32.903207 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': '2135f6c7-0718-46fa-94a8-f948e487e37f'} Jun 24 09:47:32.904049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:47:32.904049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:47:32.904049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:47:32.904049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:47:32.904049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:47:32.904049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:47:32.904049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:47:32.904049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:47:32.904049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:47:32.904049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:47:32.904049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2135f6c7-0718-46fa-94a8-f948e487e37f could not be found. Jun 24 09:47:32.904049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:32.904049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:47:32.904049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:32.904049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:47:32.904049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:47:32.904049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:47:32.904049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:47:32.904049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:47:32.904049 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:47:32.905496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:47:32.905496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:47:32.905496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:47:32.905496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:47:32.905496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:47:32.905496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:47:32.905496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:47:32.905496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2135f6c7-0718-46fa-94a8-f948e487e37f could not be found. Jun 24 09:47:32.905496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:32.905496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:47:32.905496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:32.905496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:47:32.905496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:47:32.905496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:47:32.905496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:47:32.905496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:47:32.905496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2135f6c7-0718-46fa-94a8-f948e487e37f could not be found. Jun 24 09:47:32.905496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:32.906760 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-eea44dc8-f1f6-4bff-b949-734749767c8d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] Returning 404 to user: Instance 2135f6c7-0718-46fa-94a8-f948e487e37f could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:47:32.906760 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-eea44dc8-f1f6-4bff-b949-734749767c8d tempest-ServerRescueNegativeTestJSON-2069816343 tempest-ServerRescueNegativeTestJSON-2069816343-project] 10.222.0.65 "GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f" status: 404 len: 111 microversion: 2.1 time: 0.029019 Jun 24 09:47:32.906760 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 373/728] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:32 2022] GET /compute/v2.1/servers/2135f6c7-0718-46fa-94a8-f948e487e37f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:47:33.683817 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-83dc488b-bea1-4b32-8467-49d58a1ad47b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:33.684430 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-83dc488b-bea1-4b32-8467-49d58a1ad47b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:33.692702 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-83dc488b-bea1-4b32-8467-49d58a1ad47b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:33.693169 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-83dc488b-bea1-4b32-8467-49d58a1ad47b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:33.693954 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-83dc488b-bea1-4b32-8467-49d58a1ad47b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:33.694498 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-83dc488b-bea1-4b32-8467-49d58a1ad47b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:33.720319 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-83dc488b-bea1-4b32-8467-49d58a1ad47b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Going to try to terminate instance {{(pid=124338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:47:33.794678 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=2 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:33.816404 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-83dc488b-bea1-4b32-8467-49d58a1ad47b tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 204 len: 0 microversion: 2.1 time: 0.136058 Jun 24 09:47:33.817542 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 356/729] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:47:33 2022] DELETE /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:47:33.825679 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-6c6ddf45-b573-4ea1-9000-ec7298925e06 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:33.826357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-6c6ddf45-b573-4ea1-9000-ec7298925e06 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:33.834083 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6c6ddf45-b573-4ea1-9000-ec7298925e06 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:33.834618 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6c6ddf45-b573-4ea1-9000-ec7298925e06 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:33.835477 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6c6ddf45-b573-4ea1-9000-ec7298925e06 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:33.835968 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6c6ddf45-b573-4ea1-9000-ec7298925e06 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:33.836344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-eb47be7e-f6ab-4234-b107-c81bccc44d76 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:33.841315 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-eb47be7e-f6ab-4234-b107-c81bccc44d76 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:33.850143 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=6 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:33.854401 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-eb47be7e-f6ab-4234-b107-c81bccc44d76 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:33.855093 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-eb47be7e-f6ab-4234-b107-c81bccc44d76 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:33.856139 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-eb47be7e-f6ab-4234-b107-c81bccc44d76 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:33.857840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-eb47be7e-f6ab-4234-b107-c81bccc44d76 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:33.966814 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=6 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:34.254185 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6c6ddf45-b573-4ea1-9000-ec7298925e06 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:34.254926 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-eb47be7e-f6ab-4234-b107-c81bccc44d76 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:34.262926 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-eb47be7e-f6ab-4234-b107-c81bccc44d76 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb" status: 200 len: 1367 microversion: 2.1 time: 0.432569 Jun 24 09:47:34.263538 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 357/730] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:33 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb => generated 1367 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:47:34.264556 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-6c6ddf45-b573-4ea1-9000-ec7298925e06 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1554 microversion: 2.1 time: 0.442860 Jun 24 09:47:34.274715 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 374/731] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:33 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1554 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:35.280445 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ba29633c-effc-4ebf-b01d-eca467d3f37a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:35.281392 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ba29633c-effc-4ebf-b01d-eca467d3f37a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:35.281887 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a1ec1eb7-c43b-4645-9de7-f72003eff755 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:35.282901 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-a1ec1eb7-c43b-4645-9de7-f72003eff755 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:35.289750 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a1ec1eb7-c43b-4645-9de7-f72003eff755 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:35.290193 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a1ec1eb7-c43b-4645-9de7-f72003eff755 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:35.290483 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ba29633c-effc-4ebf-b01d-eca467d3f37a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:35.291495 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a1ec1eb7-c43b-4645-9de7-f72003eff755 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:35.291951 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a1ec1eb7-c43b-4645-9de7-f72003eff755 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:35.292090 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ba29633c-effc-4ebf-b01d-eca467d3f37a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:35.292763 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ba29633c-effc-4ebf-b01d-eca467d3f37a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:35.293196 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ba29633c-effc-4ebf-b01d-eca467d3f37a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:35.495764 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ba29633c-effc-4ebf-b01d-eca467d3f37a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:35.496447 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-a1ec1eb7-c43b-4645-9de7-f72003eff755 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:35.506763 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ba29633c-effc-4ebf-b01d-eca467d3f37a tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb" status: 200 len: 1367 microversion: 2.1 time: 0.230679 Jun 24 09:47:35.508207 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-a1ec1eb7-c43b-4645-9de7-f72003eff755 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1554 microversion: 2.1 time: 0.230197 Jun 24 09:47:35.511120 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 375/732] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:35 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1554 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:35.516269 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 358/733] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:35 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:36.378667 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-9728904d-aecf-4460-b52e-ddf64fa79caf req-f7e602f6-86fe-4e03-967b-1055f8acebce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d874254-475b-4025-8b67-b4af897fdb60", "name": "network-vif-deleted", "tag": "de309464-eb94-4c38-b29b-c293a12d68b1"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:47:36.388158 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-9728904d-aecf-4460-b52e-ddf64fa79caf req-f7e602f6-86fe-4e03-967b-1055f8acebce service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:36.388599 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-9728904d-aecf-4460-b52e-ddf64fa79caf req-f7e602f6-86fe-4e03-967b-1055f8acebce service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:36.402811 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-9728904d-aecf-4460-b52e-ddf64fa79caf req-f7e602f6-86fe-4e03-967b-1055f8acebce service nova] Creating event network-vif-deleted:de309464-eb94-4c38-b29b-c293a12d68b1 for instance 0d874254-475b-4025-8b67-b4af897fdb60 on hv-cinder-80382 Jun 24 09:47:36.410053 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-9728904d-aecf-4460-b52e-ddf64fa79caf req-f7e602f6-86fe-4e03-967b-1055f8acebce service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034103 Jun 24 09:47:36.410726 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 376/734] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:36.524444 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-1f34ce69-c140-4116-9a82-0c7f7b5f68db tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:36.525685 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-1f34ce69-c140-4116-9a82-0c7f7b5f68db tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:36.537520 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-266b1fdb-b03d-49b4-8a37-9a12c6bfb390 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:36.538263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-266b1fdb-b03d-49b4-8a37-9a12c6bfb390 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:36.542669 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1f34ce69-c140-4116-9a82-0c7f7b5f68db tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:36.543756 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1f34ce69-c140-4116-9a82-0c7f7b5f68db tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:36.544747 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1f34ce69-c140-4116-9a82-0c7f7b5f68db tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:36.545184 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1f34ce69-c140-4116-9a82-0c7f7b5f68db tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:36.545404 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-266b1fdb-b03d-49b4-8a37-9a12c6bfb390 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:36.545862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-266b1fdb-b03d-49b4-8a37-9a12c6bfb390 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:36.546666 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-266b1fdb-b03d-49b4-8a37-9a12c6bfb390 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:36.547191 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-266b1fdb-b03d-49b4-8a37-9a12c6bfb390 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:36.592690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-266b1fdb-b03d-49b4-8a37-9a12c6bfb390 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:36.593144 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-266b1fdb-b03d-49b4-8a37-9a12c6bfb390 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:36.593599 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.objects.instance [None req-266b1fdb-b03d-49b4-8a37-9a12c6bfb390 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lazy-loading 'fault' on Instance uuid 0d874254-475b-4025-8b67-b4af897fdb60 {{(pid=124339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:47:36.667340 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-266b1fdb-b03d-49b4-8a37-9a12c6bfb390 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1636311c73b9461c9a64db18e8fdf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aff51028ec477ebbc12e078174977a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:36.672280 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:36.679382 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-266b1fdb-b03d-49b4-8a37-9a12c6bfb390 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 200 len: 1348 microversion: 2.1 time: 0.151052 Jun 24 09:47:36.689435 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 377/735] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:36 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 1348 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:36.732067 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-1f34ce69-c140-4116-9a82-0c7f7b5f68db tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:36.748348 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-1f34ce69-c140-4116-9a82-0c7f7b5f68db tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb" status: 200 len: 1367 microversion: 2.1 time: 0.228204 Jun 24 09:47:36.749119 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 359/736] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:36 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:37.697411 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-dcc70d80-f568-41c8-8075-2ed94d0f4261 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:37.698035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-dcc70d80-f568-41c8-8075-2ed94d0f4261 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] [instance: 0d874254-475b-4025-8b67-b4af897fdb60] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:37.706079 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dcc70d80-f568-41c8-8075-2ed94d0f4261 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:37.706735 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dcc70d80-f568-41c8-8075-2ed94d0f4261 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:37.707543 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dcc70d80-f568-41c8-8075-2ed94d0f4261 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:37.707970 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dcc70d80-f568-41c8-8075-2ed94d0f4261 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:37.724216 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-dcc70d80-f568-41c8-8075-2ed94d0f4261 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] HTTP exception thrown: Instance 0d874254-475b-4025-8b67-b4af897fdb60 could not be found. Jun 24 09:47:37.725884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-dcc70d80-f568-41c8-8075-2ed94d0f4261 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Request method failure captured: Jun 24 09:47:37.725884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 HTTP/1.1 Jun 24 09:47:37.725884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:47:37.725884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:47:37.725884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:47:37.725884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:47:37.725884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:47:37.725884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:47:37.725884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:47:37.725884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:47:37.725884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYeOn6TLL2BrdIZn-U5QaGmgX7ouMj7ppQ0wX3x_CYbFjA_miTAMoM9Nz3hrXqPCj3jVM506El9fBVcK6hV2D-TiQMas5tAFUlx0e2qWvyg-hRXWgug2C6WOlufkn__j0px1Kq74_rlILLxN9aVM3Yu3XL-cNop0Jt1tUy8UJicb3-4 Jun 24 09:47:37.725884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:47:37.725884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:47:37.725884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:47:37.725884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:47:37.725884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:47:37.725884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:47:37.725884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: a0aff51028ec477ebbc12e078174977a Jun 24 09:47:37.725884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-TestMinimumBasicScenario-1606186572 Jun 24 09:47:37.725884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:47:37.725884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:47:37.727219 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a0aff51028ec477ebbc12e078174977a", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a0aff51028ec477ebbc12e078174977a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a0aff51028ec477ebbc12e078174977a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a0aff51028ec477ebbc12e078174977a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:47:37.727219 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-TestMinimumBasicScenario-1606186572 Jun 24 09:47:37.727219 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: a0aff51028ec477ebbc12e078174977a Jun 24 09:47:37.727219 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1606186572 Jun 24 09:47:37.727219 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-TestMinimumBasicScenario-1606186572-project Jun 24 09:47:37.727219 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:47:37.727219 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:47:37.727219 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: 1636311c73b9461c9a64db18e8fdf0a3 Jun 24 09:47:37.727219 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-TestMinimumBasicScenario-1606186572-project Jun 24 09:47:37.727219 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:47:37.727219 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance 0d874254-475b-4025-8b67-b4af897fdb60 could not be found. Jun 24 09:47:37.727219 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': '0d874254-475b-4025-8b67-b4af897fdb60'} Jun 24 09:47:37.727923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:47:37.727923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:47:37.727923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:47:37.727923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:47:37.727923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:47:37.727923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:47:37.727923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:47:37.727923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:47:37.727923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:47:37.727923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:47:37.727923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d874254-475b-4025-8b67-b4af897fdb60 could not be found. Jun 24 09:47:37.727923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:37.727923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:47:37.727923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:37.727923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:47:37.727923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:47:37.727923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:47:37.727923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:47:37.727923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:47:37.727923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:47:37.729084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:47:37.729084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:47:37.729084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:47:37.729084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:47:37.729084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:47:37.729084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:47:37.729084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:47:37.729084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d874254-475b-4025-8b67-b4af897fdb60 could not be found. Jun 24 09:47:37.729084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:37.729084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:47:37.729084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:37.729084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:47:37.729084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:47:37.729084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:47:37.729084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:47:37.729084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:47:37.729084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d874254-475b-4025-8b67-b4af897fdb60 could not be found. Jun 24 09:47:37.729084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:47:37.730143 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-dcc70d80-f568-41c8-8075-2ed94d0f4261 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Returning 404 to user: Instance 0d874254-475b-4025-8b67-b4af897fdb60 could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:47:37.730143 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-dcc70d80-f568-41c8-8075-2ed94d0f4261 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60" status: 404 len: 111 microversion: 2.1 time: 0.033935 Jun 24 09:47:37.730143 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 378/737] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:37 2022] GET /compute/v2.1/servers/0d874254-475b-4025-8b67-b4af897fdb60 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:47:37.736306 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-2c6549bd-677e-4939-ba7d-6444d6bc70f4 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] Calling method '.version_select at 0x7fc6d4ca5c10>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:37.756049 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-2c6549bd-677e-4939-ba7d-6444d6bc70f4 tempest-TestMinimumBasicScenario-1606186572 tempest-TestMinimumBasicScenario-1606186572-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-747705025" status: 202 len: 0 microversion: 2.1 time: 0.023561 Jun 24 09:47:37.756990 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 360/738] 10.222.0.65 () {58 vars in 1268 bytes} [Fri Jun 24 09:47:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-747705025 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:47:37.766313 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-2d164e31-5114-4515-b465-ccb541300003 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:37.767191 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-2d164e31-5114-4515-b465-ccb541300003 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:37.773557 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2d164e31-5114-4515-b465-ccb541300003 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:37.773929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2d164e31-5114-4515-b465-ccb541300003 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:37.774728 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2d164e31-5114-4515-b465-ccb541300003 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:37.775150 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2d164e31-5114-4515-b465-ccb541300003 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:37.926046 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-2d164e31-5114-4515-b465-ccb541300003 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:37.934875 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-2d164e31-5114-4515-b465-ccb541300003 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb" status: 200 len: 1367 microversion: 2.1 time: 0.172281 Jun 24 09:47:37.935502 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 379/739] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:37 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:47:38.183114 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-977c0417-835e-40e3-9466-4ae91eb94148 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:38.183634 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-977c0417-835e-40e3-9466-4ae91eb94148 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:38.190681 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-977c0417-835e-40e3-9466-4ae91eb94148 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:38.191176 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-977c0417-835e-40e3-9466-4ae91eb94148 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:38.192464 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-977c0417-835e-40e3-9466-4ae91eb94148 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:38.192912 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-977c0417-835e-40e3-9466-4ae91eb94148 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:38.222293 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-977c0417-835e-40e3-9466-4ae91eb94148 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661/ips" status: 200 len: 152 microversion: 2.20 time: 0.255558 Jun 24 09:47:38.223484 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 361/740] 10.222.0.65 () {60 vars in 1288 bytes} [Fri Jun 24 09:47:37 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661/ips => generated 152 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:47:38.952357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-19667f8d-9f6e-471b-b7a4-b4f582bbd304 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:38.952937 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-19667f8d-9f6e-471b-b7a4-b4f582bbd304 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:38.960203 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-19667f8d-9f6e-471b-b7a4-b4f582bbd304 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:38.960633 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-19667f8d-9f6e-471b-b7a4-b4f582bbd304 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:38.961416 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-19667f8d-9f6e-471b-b7a4-b4f582bbd304 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:38.961857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-19667f8d-9f6e-471b-b7a4-b4f582bbd304 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:39.249036 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-19667f8d-9f6e-471b-b7a4-b4f582bbd304 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:39.263339 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-19667f8d-9f6e-471b-b7a4-b4f582bbd304 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb" status: 200 len: 1367 microversion: 2.1 time: 0.314660 Jun 24 09:47:39.264691 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 380/741] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:38 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb => generated 1367 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:39.434184 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-8e14a6e3-2a03-4d9e-bb22-4c6e82f3e966 req-d96f2b9a-bd4b-4ae0-af62-549e7ec42c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ad568e-23cd-4785-ac2f-89601b02e8cb", "name": "network-vif-plugged", "status": "completed", "tag": "a767a0b3-c7d0-4fd0-895f-6d471a89e711"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:47:39.443470 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-8e14a6e3-2a03-4d9e-bb22-4c6e82f3e966 req-d96f2b9a-bd4b-4ae0-af62-549e7ec42c87 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:39.444047 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-8e14a6e3-2a03-4d9e-bb22-4c6e82f3e966 req-d96f2b9a-bd4b-4ae0-af62-549e7ec42c87 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:39.455154 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-8e14a6e3-2a03-4d9e-bb22-4c6e82f3e966 req-d96f2b9a-bd4b-4ae0-af62-549e7ec42c87 service nova] Creating event network-vif-plugged:a767a0b3-c7d0-4fd0-895f-6d471a89e711 for instance 21ad568e-23cd-4785-ac2f-89601b02e8cb on hv-cinder-80382 Jun 24 09:47:39.460379 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-8e14a6e3-2a03-4d9e-bb22-4c6e82f3e966 req-d96f2b9a-bd4b-4ae0-af62-549e7ec42c87 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.296247 Jun 24 09:47:39.464299 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 362/742] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:40.279986 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-fcca989e-4025-4277-94d8-b50624754059 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:40.281184 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-fcca989e-4025-4277-94d8-b50624754059 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:40.289248 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fcca989e-4025-4277-94d8-b50624754059 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:40.289923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fcca989e-4025-4277-94d8-b50624754059 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:40.290827 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fcca989e-4025-4277-94d8-b50624754059 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:40.291470 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fcca989e-4025-4277-94d8-b50624754059 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:40.534175 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-fcca989e-4025-4277-94d8-b50624754059 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:40.542342 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-fcca989e-4025-4277-94d8-b50624754059 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb" status: 200 len: 1367 microversion: 2.1 time: 0.265841 Jun 24 09:47:40.542563 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 381/743] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:40 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:40.804268 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7fcb9bc7-82c3-4f46-8957-2a021fd5932d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:47:40.805566 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-7fcb9bc7-82c3-4f46-8957-2a021fd5932d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:40.818037 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7fcb9bc7-82c3-4f46-8957-2a021fd5932d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:40.820306 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7fcb9bc7-82c3-4f46-8957-2a021fd5932d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:40.821612 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7fcb9bc7-82c3-4f46-8957-2a021fd5932d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:40.822314 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7fcb9bc7-82c3-4f46-8957-2a021fd5932d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:40.874981 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.objects.instance [None req-7fcb9bc7-82c3-4f46-8957-2a021fd5932d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lazy-loading 'flavor' on Instance uuid 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 {{(pid=124338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:47:41.178463 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-7fcb9bc7-82c3-4f46-8957-2a021fd5932d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "POST /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661/action" status: 202 len: 0 microversion: 2.20 time: 0.383598 Jun 24 09:47:41.179230 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 363/744] 10.222.0.65 () {62 vars in 1318 bytes} [Fri Jun 24 09:47:40 2022] POST /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:47:41.188873 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-2f744c5f-7c15-468b-beff-fb33603d8a6d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:41.189812 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-2f744c5f-7c15-468b-beff-fb33603d8a6d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:41.196358 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2f744c5f-7c15-468b-beff-fb33603d8a6d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:41.197043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2f744c5f-7c15-468b-beff-fb33603d8a6d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:41.197882 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2f744c5f-7c15-468b-beff-fb33603d8a6d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:41.198374 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2f744c5f-7c15-468b-beff-fb33603d8a6d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:41.560307 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-815c606c-155d-4d88-a697-b77820a71574 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:41.561276 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-815c606c-155d-4d88-a697-b77820a71574 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:41.563793 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-2f744c5f-7c15-468b-beff-fb33603d8a6d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:41.570019 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-815c606c-155d-4d88-a697-b77820a71574 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:41.570795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-815c606c-155d-4d88-a697-b77820a71574 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:41.571959 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-815c606c-155d-4d88-a697-b77820a71574 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:41.573510 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-815c606c-155d-4d88-a697-b77820a71574 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:41.577220 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-2f744c5f-7c15-468b-beff-fb33603d8a6d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:41.578789 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-2f744c5f-7c15-468b-beff-fb33603d8a6d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:41.580261 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-2f744c5f-7c15-468b-beff-fb33603d8a6d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1724 microversion: 2.20 time: 0.396707 Jun 24 09:47:41.580944 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 382/745] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:47:41 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1724 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:47:41.867958 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-815c606c-155d-4d88-a697-b77820a71574 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:41.878016 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-815c606c-155d-4d88-a697-b77820a71574 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb" status: 200 len: 1557 microversion: 2.1 time: 0.322055 Jun 24 09:47:41.878589 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 364/746] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:47:41 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb => generated 1557 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:47:41.894879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-402abed7-b56a-44ef-a01c-d62822a4ccf4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:41.895408 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-402abed7-b56a-44ef-a01c-d62822a4ccf4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:41.902639 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-402abed7-b56a-44ef-a01c-d62822a4ccf4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:41.903104 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-402abed7-b56a-44ef-a01c-d62822a4ccf4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:41.903888 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-402abed7-b56a-44ef-a01c-d62822a4ccf4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:41.904309 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-402abed7-b56a-44ef-a01c-d62822a4ccf4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:42.056365 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-402abed7-b56a-44ef-a01c-d62822a4ccf4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.164836 Jun 24 09:47:42.059127 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 383/747] 10.222.0.65 () {58 vars in 1274 bytes} [Fri Jun 24 09:47:41 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb/os-interface => generated 285 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:42.600901 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-43a0eb3f-59e9-43dd-8196-4f0a0ce08975 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:42.601902 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-43a0eb3f-59e9-43dd-8196-4f0a0ce08975 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:42.608598 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-43a0eb3f-59e9-43dd-8196-4f0a0ce08975 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:42.610054 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-43a0eb3f-59e9-43dd-8196-4f0a0ce08975 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:42.611280 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-43a0eb3f-59e9-43dd-8196-4f0a0ce08975 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:42.612247 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-43a0eb3f-59e9-43dd-8196-4f0a0ce08975 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:42.894641 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-43a0eb3f-59e9-43dd-8196-4f0a0ce08975 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:42.908797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-43a0eb3f-59e9-43dd-8196-4f0a0ce08975 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:42.914892 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-43a0eb3f-59e9-43dd-8196-4f0a0ce08975 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:42.917048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-43a0eb3f-59e9-43dd-8196-4f0a0ce08975 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1724 microversion: 2.20 time: 0.321810 Jun 24 09:47:42.919334 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 365/748] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:47:42 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1724 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:47:43.512381 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-3b9f99be-0804-4848-9237-b54a1e87bf3b req-119d8964-c440-499f-b396-b8945a9b81e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ad568e-23cd-4785-ac2f-89601b02e8cb", "tag": "a767a0b3-c7d0-4fd0-895f-6d471a89e711"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:47:43.528330 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-3b9f99be-0804-4848-9237-b54a1e87bf3b req-119d8964-c440-499f-b396-b8945a9b81e0 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:43.529089 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-3b9f99be-0804-4848-9237-b54a1e87bf3b req-119d8964-c440-499f-b396-b8945a9b81e0 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:43.543118 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-3b9f99be-0804-4848-9237-b54a1e87bf3b req-119d8964-c440-499f-b396-b8945a9b81e0 service nova] Creating event network-changed:a767a0b3-c7d0-4fd0-895f-6d471a89e711 for instance 21ad568e-23cd-4785-ac2f-89601b02e8cb on hv-cinder-80382 Jun 24 09:47:43.549601 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-3b9f99be-0804-4848-9237-b54a1e87bf3b req-119d8964-c440-499f-b396-b8945a9b81e0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044248 Jun 24 09:47:43.551194 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 384/749] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:43.941726 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-667eac91-571a-4577-8c75-0e5ad2fa30b1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:43.944234 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-667eac91-571a-4577-8c75-0e5ad2fa30b1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:43.957195 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:43.960457 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-667eac91-571a-4577-8c75-0e5ad2fa30b1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:43.961137 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-667eac91-571a-4577-8c75-0e5ad2fa30b1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:43.965440 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-667eac91-571a-4577-8c75-0e5ad2fa30b1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:43.966639 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-667eac91-571a-4577-8c75-0e5ad2fa30b1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:44.336240 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-667eac91-571a-4577-8c75-0e5ad2fa30b1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:44.351500 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-667eac91-571a-4577-8c75-0e5ad2fa30b1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:44.357713 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-667eac91-571a-4577-8c75-0e5ad2fa30b1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:44.360074 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-667eac91-571a-4577-8c75-0e5ad2fa30b1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1724 microversion: 2.20 time: 0.424627 Jun 24 09:47:44.371797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 366/750] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:47:43 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1724 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:47:45.381765 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c83729b9-9fee-4db2-98f3-ea328071c8d9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:45.382629 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-c83729b9-9fee-4db2-98f3-ea328071c8d9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:45.389333 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c83729b9-9fee-4db2-98f3-ea328071c8d9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:45.389792 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c83729b9-9fee-4db2-98f3-ea328071c8d9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:45.390537 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c83729b9-9fee-4db2-98f3-ea328071c8d9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:45.390980 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c83729b9-9fee-4db2-98f3-ea328071c8d9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:45.593465 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c83729b9-9fee-4db2-98f3-ea328071c8d9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:45.602409 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c83729b9-9fee-4db2-98f3-ea328071c8d9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:45.603969 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c83729b9-9fee-4db2-98f3-ea328071c8d9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:45.605141 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-c83729b9-9fee-4db2-98f3-ea328071c8d9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1724 microversion: 2.20 time: 0.228727 Jun 24 09:47:45.605674 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 385/751] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:47:45 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:47:46.623850 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-85438404-1099-4e42-b9c3-f57dae731475 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:46.624583 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-85438404-1099-4e42-b9c3-f57dae731475 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:46.632791 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-85438404-1099-4e42-b9c3-f57dae731475 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:46.633234 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-85438404-1099-4e42-b9c3-f57dae731475 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:46.634008 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-85438404-1099-4e42-b9c3-f57dae731475 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:46.634431 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-85438404-1099-4e42-b9c3-f57dae731475 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:46.834637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-85438404-1099-4e42-b9c3-f57dae731475 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:46.843314 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-85438404-1099-4e42-b9c3-f57dae731475 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:46.844806 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-85438404-1099-4e42-b9c3-f57dae731475 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:46.847295 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-85438404-1099-4e42-b9c3-f57dae731475 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1724 microversion: 2.20 time: 0.227409 Jun 24 09:47:46.847858 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 367/752] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:47:46 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:47:47.866658 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e2aba249-0743-4ecf-9fd9-5c85ef762cbe tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:47.867884 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e2aba249-0743-4ecf-9fd9-5c85ef762cbe tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:47.875190 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e2aba249-0743-4ecf-9fd9-5c85ef762cbe tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:47.875913 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e2aba249-0743-4ecf-9fd9-5c85ef762cbe tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:47.876762 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e2aba249-0743-4ecf-9fd9-5c85ef762cbe tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:47.877774 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e2aba249-0743-4ecf-9fd9-5c85ef762cbe tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:48.087524 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e2aba249-0743-4ecf-9fd9-5c85ef762cbe tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:48.097964 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e2aba249-0743-4ecf-9fd9-5c85ef762cbe tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:48.099672 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e2aba249-0743-4ecf-9fd9-5c85ef762cbe tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:48.100883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e2aba249-0743-4ecf-9fd9-5c85ef762cbe tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1724 microversion: 2.20 time: 0.238854 Jun 24 09:47:48.101760 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 386/753] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:47:47 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:47:49.122256 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-2e1789f1-e81a-4caf-a7d6-9914a5098ec8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:49.123165 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-2e1789f1-e81a-4caf-a7d6-9914a5098ec8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:49.130572 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2e1789f1-e81a-4caf-a7d6-9914a5098ec8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:49.131026 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2e1789f1-e81a-4caf-a7d6-9914a5098ec8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:49.131884 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2e1789f1-e81a-4caf-a7d6-9914a5098ec8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:49.132317 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2e1789f1-e81a-4caf-a7d6-9914a5098ec8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:49.269631 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-2e1789f1-e81a-4caf-a7d6-9914a5098ec8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:49.278199 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-2e1789f1-e81a-4caf-a7d6-9914a5098ec8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:49.279785 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-2e1789f1-e81a-4caf-a7d6-9914a5098ec8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:49.280971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-2e1789f1-e81a-4caf-a7d6-9914a5098ec8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1724 microversion: 2.20 time: 0.164904 Jun 24 09:47:49.281518 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 368/754] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:47:49 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:47:50.300924 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-41a20519-dcb1-450d-9c9b-3f34854b7da9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:50.301596 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-41a20519-dcb1-450d-9c9b-3f34854b7da9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:50.308650 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-41a20519-dcb1-450d-9c9b-3f34854b7da9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:50.309092 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-41a20519-dcb1-450d-9c9b-3f34854b7da9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:50.309856 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-41a20519-dcb1-450d-9c9b-3f34854b7da9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:50.310288 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-41a20519-dcb1-450d-9c9b-3f34854b7da9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:50.458439 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-41a20519-dcb1-450d-9c9b-3f34854b7da9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:50.466629 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-41a20519-dcb1-450d-9c9b-3f34854b7da9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:50.468241 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-41a20519-dcb1-450d-9c9b-3f34854b7da9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:50.469423 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-41a20519-dcb1-450d-9c9b-3f34854b7da9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1724 microversion: 2.20 time: 0.172753 Jun 24 09:47:50.470949 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 387/755] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:47:50 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:47:51.490026 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-9897be40-a2d7-4ed9-9124-2429d70c62a5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:51.490646 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-9897be40-a2d7-4ed9-9124-2429d70c62a5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:51.497697 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9897be40-a2d7-4ed9-9124-2429d70c62a5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:51.498139 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9897be40-a2d7-4ed9-9124-2429d70c62a5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:51.498912 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9897be40-a2d7-4ed9-9124-2429d70c62a5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:51.499390 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9897be40-a2d7-4ed9-9124-2429d70c62a5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:51.639402 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-9897be40-a2d7-4ed9-9124-2429d70c62a5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:51.647956 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-9897be40-a2d7-4ed9-9124-2429d70c62a5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:51.649488 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-9897be40-a2d7-4ed9-9124-2429d70c62a5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:51.650681 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-9897be40-a2d7-4ed9-9124-2429d70c62a5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1724 microversion: 2.20 time: 0.164810 Jun 24 09:47:51.661968 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 369/756] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:47:51 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:47:52.670088 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-12893a72-39c5-476f-b405-ad79ebd0a46d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:52.670766 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-12893a72-39c5-476f-b405-ad79ebd0a46d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:52.678280 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-12893a72-39c5-476f-b405-ad79ebd0a46d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:52.678735 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-12893a72-39c5-476f-b405-ad79ebd0a46d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:52.679543 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-12893a72-39c5-476f-b405-ad79ebd0a46d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:52.679984 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-12893a72-39c5-476f-b405-ad79ebd0a46d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:52.821796 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-12893a72-39c5-476f-b405-ad79ebd0a46d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:52.829992 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-12893a72-39c5-476f-b405-ad79ebd0a46d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:52.831748 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-12893a72-39c5-476f-b405-ad79ebd0a46d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:52.832918 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-12893a72-39c5-476f-b405-ad79ebd0a46d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1745 microversion: 2.20 time: 0.167296 Jun 24 09:47:52.833487 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 388/757] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:47:52 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:47:53.852497 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-86fe67ab-2759-4943-b12a-18a0e561a80c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:53.853188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-86fe67ab-2759-4943-b12a-18a0e561a80c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:53.860349 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-86fe67ab-2759-4943-b12a-18a0e561a80c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:53.860793 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-86fe67ab-2759-4943-b12a-18a0e561a80c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:53.861556 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-86fe67ab-2759-4943-b12a-18a0e561a80c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:53.862592 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-86fe67ab-2759-4943-b12a-18a0e561a80c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:53.881789 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:54.011048 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-86fe67ab-2759-4943-b12a-18a0e561a80c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:54.023901 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-86fe67ab-2759-4943-b12a-18a0e561a80c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:54.026279 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-86fe67ab-2759-4943-b12a-18a0e561a80c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:54.028240 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-86fe67ab-2759-4943-b12a-18a0e561a80c tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1745 microversion: 2.20 time: 0.180216 Jun 24 09:47:54.029052 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 370/758] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:47:53 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:47:55.048765 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a4442db8-679c-4a16-9a61-cd2d9b6a7f2d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:55.049372 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-a4442db8-679c-4a16-9a61-cd2d9b6a7f2d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:55.067601 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a4442db8-679c-4a16-9a61-cd2d9b6a7f2d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:55.067739 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a4442db8-679c-4a16-9a61-cd2d9b6a7f2d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:55.068452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a4442db8-679c-4a16-9a61-cd2d9b6a7f2d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:55.068890 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a4442db8-679c-4a16-9a61-cd2d9b6a7f2d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:55.245799 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-a4442db8-679c-4a16-9a61-cd2d9b6a7f2d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:55.254638 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-a4442db8-679c-4a16-9a61-cd2d9b6a7f2d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:55.257037 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-a4442db8-679c-4a16-9a61-cd2d9b6a7f2d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:55.258395 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-a4442db8-679c-4a16-9a61-cd2d9b6a7f2d tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1740 microversion: 2.20 time: 0.213731 Jun 24 09:47:55.258967 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 389/759] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:47:55 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:47:56.279122 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-1f921bdf-d99b-4994-83e5-ace9d72dc9a9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:56.280669 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-1f921bdf-d99b-4994-83e5-ace9d72dc9a9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:56.290266 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1f921bdf-d99b-4994-83e5-ace9d72dc9a9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:56.290931 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1f921bdf-d99b-4994-83e5-ace9d72dc9a9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:56.291919 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1f921bdf-d99b-4994-83e5-ace9d72dc9a9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:56.292512 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1f921bdf-d99b-4994-83e5-ace9d72dc9a9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:56.459438 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-1f921bdf-d99b-4994-83e5-ace9d72dc9a9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:56.467917 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-1f921bdf-d99b-4994-83e5-ace9d72dc9a9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:56.470850 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-1f921bdf-d99b-4994-83e5-ace9d72dc9a9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:56.472395 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-1f921bdf-d99b-4994-83e5-ace9d72dc9a9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1740 microversion: 2.20 time: 0.198792 Jun 24 09:47:56.473096 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 371/760] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:47:56 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:47:57.248335 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-293f047d-5cf3-465a-846b-8c01e0347dec req-a1130399-a210-4af4-8235-4e281c8397b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661", "name": "network-vif-plugged", "status": "completed", "tag": "6a505089-ab65-4375-b6e7-fc2f8ad2fb21"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:47:57.259858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-293f047d-5cf3-465a-846b-8c01e0347dec req-a1130399-a210-4af4-8235-4e281c8397b5 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:57.260488 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-293f047d-5cf3-465a-846b-8c01e0347dec req-a1130399-a210-4af4-8235-4e281c8397b5 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:57.273603 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-293f047d-5cf3-465a-846b-8c01e0347dec req-a1130399-a210-4af4-8235-4e281c8397b5 service nova] Creating event network-vif-plugged:6a505089-ab65-4375-b6e7-fc2f8ad2fb21 for instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 on hv-cinder-80382 Jun 24 09:47:57.279683 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-293f047d-5cf3-465a-846b-8c01e0347dec req-a1130399-a210-4af4-8235-4e281c8397b5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034967 Jun 24 09:47:57.283027 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 390/761] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:47:57.493055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ba5cd3e1-b84c-4552-a2e4-8dd2faa734a8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:57.493678 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ba5cd3e1-b84c-4552-a2e4-8dd2faa734a8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:57.500349 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ba5cd3e1-b84c-4552-a2e4-8dd2faa734a8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:57.501076 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ba5cd3e1-b84c-4552-a2e4-8dd2faa734a8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:57.502033 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ba5cd3e1-b84c-4552-a2e4-8dd2faa734a8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:57.502675 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ba5cd3e1-b84c-4552-a2e4-8dd2faa734a8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:57.678475 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ba5cd3e1-b84c-4552-a2e4-8dd2faa734a8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:57.689604 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ba5cd3e1-b84c-4552-a2e4-8dd2faa734a8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:57.691809 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ba5cd3e1-b84c-4552-a2e4-8dd2faa734a8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:57.693363 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ba5cd3e1-b84c-4552-a2e4-8dd2faa734a8 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1740 microversion: 2.20 time: 0.204213 Jun 24 09:47:57.694548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 372/762] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:47:57 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:47:58.716259 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-d7e4c2e7-155f-4466-8395-c38e64a0bb05 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:58.716766 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-d7e4c2e7-155f-4466-8395-c38e64a0bb05 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:58.731582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d7e4c2e7-155f-4466-8395-c38e64a0bb05 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:58.732324 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d7e4c2e7-155f-4466-8395-c38e64a0bb05 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:58.733490 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d7e4c2e7-155f-4466-8395-c38e64a0bb05 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:58.734072 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d7e4c2e7-155f-4466-8395-c38e64a0bb05 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:58.919424 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-d7e4c2e7-155f-4466-8395-c38e64a0bb05 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:58.932640 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-d7e4c2e7-155f-4466-8395-c38e64a0bb05 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:58.934470 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-d7e4c2e7-155f-4466-8395-c38e64a0bb05 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:47:58.935876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-d7e4c2e7-155f-4466-8395-c38e64a0bb05 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1740 microversion: 2.20 time: 0.227539 Jun 24 09:47:58.936437 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 391/763] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:47:58 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:47:59.965422 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-d3f1b21f-161a-474d-9beb-4a220775f5a6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:47:59.966078 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-d3f1b21f-161a-474d-9beb-4a220775f5a6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:47:59.977072 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d3f1b21f-161a-474d-9beb-4a220775f5a6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:59.977818 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d3f1b21f-161a-474d-9beb-4a220775f5a6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:47:59.978766 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d3f1b21f-161a-474d-9beb-4a220775f5a6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:47:59.979402 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d3f1b21f-161a-474d-9beb-4a220775f5a6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:00.167242 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d3f1b21f-161a-474d-9beb-4a220775f5a6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:00.185949 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d3f1b21f-161a-474d-9beb-4a220775f5a6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:00.188887 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d3f1b21f-161a-474d-9beb-4a220775f5a6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:00.190582 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-d3f1b21f-161a-474d-9beb-4a220775f5a6 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1740 microversion: 2.20 time: 0.236769 Jun 24 09:48:00.191591 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 373/764] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:47:59 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:48:01.211180 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-ec2ec495-942e-43c6-aece-c3d9691510f5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:01.212580 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-ec2ec495-942e-43c6-aece-c3d9691510f5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:01.221786 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ec2ec495-942e-43c6-aece-c3d9691510f5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:01.222656 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ec2ec495-942e-43c6-aece-c3d9691510f5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:01.223653 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ec2ec495-942e-43c6-aece-c3d9691510f5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:01.224252 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ec2ec495-942e-43c6-aece-c3d9691510f5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:01.465019 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ec2ec495-942e-43c6-aece-c3d9691510f5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:01.476377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ec2ec495-942e-43c6-aece-c3d9691510f5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:01.477783 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ec2ec495-942e-43c6-aece-c3d9691510f5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:01.479317 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-ec2ec495-942e-43c6-aece-c3d9691510f5 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1740 microversion: 2.20 time: 0.273341 Jun 24 09:48:01.481228 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 392/765] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:01 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:48:02.499614 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-6cc644e2-4c8e-4b01-b230-f03d03c87419 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:02.501694 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-6cc644e2-4c8e-4b01-b230-f03d03c87419 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:02.511722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6cc644e2-4c8e-4b01-b230-f03d03c87419 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:02.512641 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6cc644e2-4c8e-4b01-b230-f03d03c87419 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:02.513569 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6cc644e2-4c8e-4b01-b230-f03d03c87419 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:02.514038 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6cc644e2-4c8e-4b01-b230-f03d03c87419 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:02.695718 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-6cc644e2-4c8e-4b01-b230-f03d03c87419 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:02.711223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-6cc644e2-4c8e-4b01-b230-f03d03c87419 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:02.714941 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-6cc644e2-4c8e-4b01-b230-f03d03c87419 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:02.722617 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-6cc644e2-4c8e-4b01-b230-f03d03c87419 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1740 microversion: 2.20 time: 0.227923 Jun 24 09:48:02.737443 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 374/766] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:02 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1740 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:48:03.742002 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f6ee1f32-c666-447d-b07d-70a3281e3f28 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:03.742968 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-f6ee1f32-c666-447d-b07d-70a3281e3f28 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:03.746328 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=50 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:03.752421 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f6ee1f32-c666-447d-b07d-70a3281e3f28 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:03.753255 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f6ee1f32-c666-447d-b07d-70a3281e3f28 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:03.754245 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f6ee1f32-c666-447d-b07d-70a3281e3f28 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:03.754881 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f6ee1f32-c666-447d-b07d-70a3281e3f28 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:03.951538 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-f6ee1f32-c666-447d-b07d-70a3281e3f28 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:03.964605 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-f6ee1f32-c666-447d-b07d-70a3281e3f28 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:03.967062 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-f6ee1f32-c666-447d-b07d-70a3281e3f28 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:03.970957 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f6ee1f32-c666-447d-b07d-70a3281e3f28 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1740 microversion: 2.20 time: 0.232146 Jun 24 09:48:03.982999 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 393/767] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:03 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:48:04.990295 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-d54392fe-3497-4fd8-92f5-a1d179afb2e2 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:04.990934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-d54392fe-3497-4fd8-92f5-a1d179afb2e2 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:04.997986 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d54392fe-3497-4fd8-92f5-a1d179afb2e2 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:04.998488 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d54392fe-3497-4fd8-92f5-a1d179afb2e2 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:04.999229 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d54392fe-3497-4fd8-92f5-a1d179afb2e2 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:04.999678 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d54392fe-3497-4fd8-92f5-a1d179afb2e2 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:05.205529 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d54392fe-3497-4fd8-92f5-a1d179afb2e2 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:05.217640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d54392fe-3497-4fd8-92f5-a1d179afb2e2 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:05.219817 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d54392fe-3497-4fd8-92f5-a1d179afb2e2 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:05.221117 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-d54392fe-3497-4fd8-92f5-a1d179afb2e2 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1722 microversion: 2.20 time: 0.235132 Jun 24 09:48:05.221767 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 375/768] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:04 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:48:06.244552 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f5d0ec9f-481d-47dc-8804-02e324901948 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:06.245587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-f5d0ec9f-481d-47dc-8804-02e324901948 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:06.255487 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f5d0ec9f-481d-47dc-8804-02e324901948 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:06.255934 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f5d0ec9f-481d-47dc-8804-02e324901948 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:06.256706 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f5d0ec9f-481d-47dc-8804-02e324901948 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:06.257140 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f5d0ec9f-481d-47dc-8804-02e324901948 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:06.398553 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-f5d0ec9f-481d-47dc-8804-02e324901948 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:06.407293 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-f5d0ec9f-481d-47dc-8804-02e324901948 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:06.408806 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-f5d0ec9f-481d-47dc-8804-02e324901948 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:06.410080 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f5d0ec9f-481d-47dc-8804-02e324901948 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1722 microversion: 2.20 time: 0.172380 Jun 24 09:48:06.410644 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 394/769] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:06 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:48:07.428837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-f775dc97-3882-4032-9279-14e505582825 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:07.429807 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-f775dc97-3882-4032-9279-14e505582825 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:07.438012 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f775dc97-3882-4032-9279-14e505582825 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:07.438534 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f775dc97-3882-4032-9279-14e505582825 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:07.439333 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f775dc97-3882-4032-9279-14e505582825 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:07.439868 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f775dc97-3882-4032-9279-14e505582825 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:07.585550 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f775dc97-3882-4032-9279-14e505582825 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:07.598284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f775dc97-3882-4032-9279-14e505582825 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:07.599816 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f775dc97-3882-4032-9279-14e505582825 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:07.600979 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-f775dc97-3882-4032-9279-14e505582825 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1665 microversion: 2.20 time: 0.176624 Jun 24 09:48:07.601535 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 376/770] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:07 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1665 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:48:07.619542 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c1287182-73f6-47d4-b9fd-8f502eafcd4e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73caae87-79a3-4c85-9216-6f1ce2d437aa"}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:48:07.620635 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-c1287182-73f6-47d4-b9fd-8f502eafcd4e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:07.628017 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c1287182-73f6-47d4-b9fd-8f502eafcd4e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:07.628811 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c1287182-73f6-47d4-b9fd-8f502eafcd4e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:07.629793 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c1287182-73f6-47d4-b9fd-8f502eafcd4e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:07.630344 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c1287182-73f6-47d4-b9fd-8f502eafcd4e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:07.716927 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=93 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:07.947346 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-c1287182-73f6-47d4-b9fd-8f502eafcd4e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "POST /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.331988 Jun 24 09:48:07.948003 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 395/771] 10.222.0.65 () {62 vars in 1363 bytes} [Fri Jun 24 09:48:07 2022] POST /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661/os-volume_attachments => generated 188 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:48:08.065320 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-a8e5be97-b8ee-48e8-8f17-25397a7fbcb0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:08.066090 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-a8e5be97-b8ee-48e8-8f17-25397a7fbcb0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:08.072000 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a8e5be97-b8ee-48e8-8f17-25397a7fbcb0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:08.072457 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a8e5be97-b8ee-48e8-8f17-25397a7fbcb0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:08.073298 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a8e5be97-b8ee-48e8-8f17-25397a7fbcb0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:08.073648 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a8e5be97-b8ee-48e8-8f17-25397a7fbcb0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:08.323556 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-a8e5be97-b8ee-48e8-8f17-25397a7fbcb0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661/os-volume_attachments/73caae87-79a3-4c85-9216-6f1ce2d437aa" status: 202 len: 0 microversion: 2.20 time: 0.262198 Jun 24 09:48:08.324266 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 377/772] 10.222.0.65 () {60 vars in 1456 bytes} [Fri Jun 24 09:48:08 2022] DELETE /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661/os-volume_attachments/73caae87-79a3-4c85-9216-6f1ce2d437aa => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:48:08.383409 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f92de4da-fc6b-4d0f-b57c-10e24a3d1d78 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:48:08.383977 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-f92de4da-fc6b-4d0f-b57c-10e24a3d1d78 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:08.390688 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f92de4da-fc6b-4d0f-b57c-10e24a3d1d78 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:08.391174 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f92de4da-fc6b-4d0f-b57c-10e24a3d1d78 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:08.391938 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f92de4da-fc6b-4d0f-b57c-10e24a3d1d78 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:08.392361 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f92de4da-fc6b-4d0f-b57c-10e24a3d1d78 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:08.601740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f92de4da-fc6b-4d0f-b57c-10e24a3d1d78 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "POST /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661/action" status: 202 len: 0 microversion: 2.20 time: 0.222337 Jun 24 09:48:08.602428 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 396/773] 10.222.0.65 () {62 vars in 1318 bytes} [Fri Jun 24 09:48:08 2022] POST /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:48:08.610942 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ec467828-cb6c-453d-a668-fad68d78f86a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:08.611672 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ec467828-cb6c-453d-a668-fad68d78f86a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:08.621640 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ec467828-cb6c-453d-a668-fad68d78f86a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:08.622084 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ec467828-cb6c-453d-a668-fad68d78f86a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:08.623325 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ec467828-cb6c-453d-a668-fad68d78f86a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:08.623904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ec467828-cb6c-453d-a668-fad68d78f86a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:08.758661 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ec467828-cb6c-453d-a668-fad68d78f86a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:08.767104 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ec467828-cb6c-453d-a668-fad68d78f86a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:08.768586 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ec467828-cb6c-453d-a668-fad68d78f86a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:08.770468 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ec467828-cb6c-453d-a668-fad68d78f86a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1673 microversion: 2.20 time: 0.162985 Jun 24 09:48:08.771068 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 378/774] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:08 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:48:09.291456 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-af0a6d1b-1d7d-4369-9a8a-50825b0b05a6 req-7c038744-d7c0-4980-ad6d-0dd6d77a547f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661", "name": "network-vif-unplugged", "status": "completed", "tag": "6a505089-ab65-4375-b6e7-fc2f8ad2fb21"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:48:09.301106 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-af0a6d1b-1d7d-4369-9a8a-50825b0b05a6 req-7c038744-d7c0-4980-ad6d-0dd6d77a547f service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:09.301822 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-af0a6d1b-1d7d-4369-9a8a-50825b0b05a6 req-7c038744-d7c0-4980-ad6d-0dd6d77a547f service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:09.314624 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.compute.server_external_events [req-af0a6d1b-1d7d-4369-9a8a-50825b0b05a6 req-7c038744-d7c0-4980-ad6d-0dd6d77a547f service nova] Unable to find a host for instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661. Dropping event network-vif-unplugged {{(pid=124339) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 24 09:48:09.315766 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-af0a6d1b-1d7d-4369-9a8a-50825b0b05a6 req-7c038744-d7c0-4980-ad6d-0dd6d77a547f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028691 Jun 24 09:48:09.316848 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 397/775] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 24 09:48:09.791713 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ee2db7e6-7ee3-4d8d-bab2-61d17a12e898 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:09.793044 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ee2db7e6-7ee3-4d8d-bab2-61d17a12e898 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:09.800193 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ee2db7e6-7ee3-4d8d-bab2-61d17a12e898 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:09.800843 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ee2db7e6-7ee3-4d8d-bab2-61d17a12e898 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:09.802355 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ee2db7e6-7ee3-4d8d-bab2-61d17a12e898 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:09.802805 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ee2db7e6-7ee3-4d8d-bab2-61d17a12e898 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:09.949141 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ee2db7e6-7ee3-4d8d-bab2-61d17a12e898 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:09.958076 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ee2db7e6-7ee3-4d8d-bab2-61d17a12e898 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:09.959621 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ee2db7e6-7ee3-4d8d-bab2-61d17a12e898 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:09.960779 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ee2db7e6-7ee3-4d8d-bab2-61d17a12e898 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1731 microversion: 2.20 time: 0.174479 Jun 24 09:48:09.961342 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 379/776] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:09 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:48:10.979958 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-6b4f9cbf-a134-4861-81b7-9351781094af tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:10.980554 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-6b4f9cbf-a134-4861-81b7-9351781094af tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:10.987058 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6b4f9cbf-a134-4861-81b7-9351781094af tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:10.987532 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6b4f9cbf-a134-4861-81b7-9351781094af tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:10.988409 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6b4f9cbf-a134-4861-81b7-9351781094af tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:10.988901 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6b4f9cbf-a134-4861-81b7-9351781094af tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:11.129926 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6b4f9cbf-a134-4861-81b7-9351781094af tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:11.138638 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6b4f9cbf-a134-4861-81b7-9351781094af tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:11.140191 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6b4f9cbf-a134-4861-81b7-9351781094af tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:11.141574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-6b4f9cbf-a134-4861-81b7-9351781094af tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1731 microversion: 2.20 time: 0.165499 Jun 24 09:48:11.142623 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 398/777] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:10 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:48:12.163754 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-34550bd8-2249-41ae-9aa8-3d9d20bb43ac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:12.164565 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-34550bd8-2249-41ae-9aa8-3d9d20bb43ac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:12.171440 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-34550bd8-2249-41ae-9aa8-3d9d20bb43ac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:12.171998 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-34550bd8-2249-41ae-9aa8-3d9d20bb43ac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:12.172842 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-34550bd8-2249-41ae-9aa8-3d9d20bb43ac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:12.173325 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-34550bd8-2249-41ae-9aa8-3d9d20bb43ac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:12.318418 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-34550bd8-2249-41ae-9aa8-3d9d20bb43ac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:12.326751 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-34550bd8-2249-41ae-9aa8-3d9d20bb43ac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:12.328287 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-34550bd8-2249-41ae-9aa8-3d9d20bb43ac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:12.329474 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-34550bd8-2249-41ae-9aa8-3d9d20bb43ac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1731 microversion: 2.20 time: 0.171345 Jun 24 09:48:12.340409 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 380/778] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:12 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:48:13.348072 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-2aff41a7-c0ff-4aa2-bd5b-78c21d7cb009 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:13.349680 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-2aff41a7-c0ff-4aa2-bd5b-78c21d7cb009 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:13.357108 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2aff41a7-c0ff-4aa2-bd5b-78c21d7cb009 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:13.357548 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2aff41a7-c0ff-4aa2-bd5b-78c21d7cb009 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:13.358315 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2aff41a7-c0ff-4aa2-bd5b-78c21d7cb009 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:13.358745 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2aff41a7-c0ff-4aa2-bd5b-78c21d7cb009 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:13.522887 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-2aff41a7-c0ff-4aa2-bd5b-78c21d7cb009 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:13.532539 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-2aff41a7-c0ff-4aa2-bd5b-78c21d7cb009 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:13.534046 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-2aff41a7-c0ff-4aa2-bd5b-78c21d7cb009 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:13.535625 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-2aff41a7-c0ff-4aa2-bd5b-78c21d7cb009 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1731 microversion: 2.20 time: 0.191780 Jun 24 09:48:13.536288 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 399/779] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:13 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:48:14.556733 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-77b97a78-ef4e-4769-a1f1-f04205ff6b1b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:14.557766 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-77b97a78-ef4e-4769-a1f1-f04205ff6b1b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:14.559457 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=30 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:14.569602 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-77b97a78-ef4e-4769-a1f1-f04205ff6b1b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:14.570759 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-77b97a78-ef4e-4769-a1f1-f04205ff6b1b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:14.572424 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-77b97a78-ef4e-4769-a1f1-f04205ff6b1b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:14.573414 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-77b97a78-ef4e-4769-a1f1-f04205ff6b1b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:14.901480 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-77b97a78-ef4e-4769-a1f1-f04205ff6b1b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:14.914791 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-77b97a78-ef4e-4769-a1f1-f04205ff6b1b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:14.917779 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-77b97a78-ef4e-4769-a1f1-f04205ff6b1b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:14.919985 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-77b97a78-ef4e-4769-a1f1-f04205ff6b1b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1731 microversion: 2.20 time: 0.367320 Jun 24 09:48:14.920968 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 381/780] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:14 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1731 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:48:15.940158 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c40acf78-6a10-42b0-89b6-0c78377c42fd tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:15.940850 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-c40acf78-6a10-42b0-89b6-0c78377c42fd tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:15.949776 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c40acf78-6a10-42b0-89b6-0c78377c42fd tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:15.956804 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c40acf78-6a10-42b0-89b6-0c78377c42fd tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:15.958106 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c40acf78-6a10-42b0-89b6-0c78377c42fd tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:15.958731 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c40acf78-6a10-42b0-89b6-0c78377c42fd tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:16.111176 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c40acf78-6a10-42b0-89b6-0c78377c42fd tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:16.120010 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c40acf78-6a10-42b0-89b6-0c78377c42fd tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:16.121479 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c40acf78-6a10-42b0-89b6-0c78377c42fd tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:16.122621 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-c40acf78-6a10-42b0-89b6-0c78377c42fd tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1731 microversion: 2.20 time: 0.186519 Jun 24 09:48:16.123201 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 400/781] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:15 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:48:17.142403 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-fb8d077e-5cb8-4e45-840a-23a51ab01ca7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:17.143783 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-fb8d077e-5cb8-4e45-840a-23a51ab01ca7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:17.151376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fb8d077e-5cb8-4e45-840a-23a51ab01ca7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:17.152703 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fb8d077e-5cb8-4e45-840a-23a51ab01ca7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:17.154021 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fb8d077e-5cb8-4e45-840a-23a51ab01ca7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:17.154695 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fb8d077e-5cb8-4e45-840a-23a51ab01ca7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:17.297124 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-fb8d077e-5cb8-4e45-840a-23a51ab01ca7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:17.305442 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-fb8d077e-5cb8-4e45-840a-23a51ab01ca7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:17.306983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-fb8d077e-5cb8-4e45-840a-23a51ab01ca7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:17.308203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-fb8d077e-5cb8-4e45-840a-23a51ab01ca7 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1731 microversion: 2.20 time: 0.169826 Jun 24 09:48:17.308765 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 382/782] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:17 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:48:18.326170 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-dbeb32cf-ffb1-41fe-88bd-e370a3deda31 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:18.327391 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-dbeb32cf-ffb1-41fe-88bd-e370a3deda31 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:18.334621 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dbeb32cf-ffb1-41fe-88bd-e370a3deda31 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:18.335098 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dbeb32cf-ffb1-41fe-88bd-e370a3deda31 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:18.335889 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dbeb32cf-ffb1-41fe-88bd-e370a3deda31 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:18.336330 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dbeb32cf-ffb1-41fe-88bd-e370a3deda31 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:18.558530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-dbeb32cf-ffb1-41fe-88bd-e370a3deda31 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:18.568714 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-dbeb32cf-ffb1-41fe-88bd-e370a3deda31 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:18.570589 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-dbeb32cf-ffb1-41fe-88bd-e370a3deda31 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:18.571778 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-dbeb32cf-ffb1-41fe-88bd-e370a3deda31 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1731 microversion: 2.20 time: 0.249887 Jun 24 09:48:18.572829 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 401/783] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:18 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1731 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:48:19.589923 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-cb114e2a-5bab-48c8-a4fd-adc051bb2a29 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:19.590542 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-cb114e2a-5bab-48c8-a4fd-adc051bb2a29 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:19.598413 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-cb114e2a-5bab-48c8-a4fd-adc051bb2a29 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:19.598864 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-cb114e2a-5bab-48c8-a4fd-adc051bb2a29 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:19.599678 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-cb114e2a-5bab-48c8-a4fd-adc051bb2a29 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:19.600152 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-cb114e2a-5bab-48c8-a4fd-adc051bb2a29 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:19.746804 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-cb114e2a-5bab-48c8-a4fd-adc051bb2a29 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:19.757157 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-cb114e2a-5bab-48c8-a4fd-adc051bb2a29 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:19.758912 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-cb114e2a-5bab-48c8-a4fd-adc051bb2a29 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:19.760451 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-cb114e2a-5bab-48c8-a4fd-adc051bb2a29 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1731 microversion: 2.20 time: 0.174505 Jun 24 09:48:19.761238 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 383/784] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:19 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:48:20.781052 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-987bc6c4-f6ac-4b76-8b9f-7af5fd845aa4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:20.781644 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-987bc6c4-f6ac-4b76-8b9f-7af5fd845aa4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:20.789206 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-987bc6c4-f6ac-4b76-8b9f-7af5fd845aa4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:20.789691 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-987bc6c4-f6ac-4b76-8b9f-7af5fd845aa4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:20.790398 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-987bc6c4-f6ac-4b76-8b9f-7af5fd845aa4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:20.790825 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-987bc6c4-f6ac-4b76-8b9f-7af5fd845aa4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:20.936777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-987bc6c4-f6ac-4b76-8b9f-7af5fd845aa4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:20.945321 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-987bc6c4-f6ac-4b76-8b9f-7af5fd845aa4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:20.946964 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-987bc6c4-f6ac-4b76-8b9f-7af5fd845aa4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:20.948244 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-987bc6c4-f6ac-4b76-8b9f-7af5fd845aa4 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1731 microversion: 2.20 time: 0.172175 Jun 24 09:48:20.948880 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 402/785] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:20 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:48:21.640101 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-5be50126-9389-4c7c-a567-f64f5de03dc3 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:21.640797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-5be50126-9389-4c7c-a567-f64f5de03dc3 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:21.647861 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5be50126-9389-4c7c-a567-f64f5de03dc3 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:21.648309 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5be50126-9389-4c7c-a567-f64f5de03dc3 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:21.649085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5be50126-9389-4c7c-a567-f64f5de03dc3 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:21.649520 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5be50126-9389-4c7c-a567-f64f5de03dc3 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:21.677687 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-5be50126-9389-4c7c-a567-f64f5de03dc3 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb/ips" status: 200 len: 149 microversion: 2.1 time: 0.041442 Jun 24 09:48:21.680700 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 384/786] 10.222.0.65 () {58 vars in 1247 bytes} [Fri Jun 24 09:48:21 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:48:21.966724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-5956e562-b5a3-4c9b-a357-00517f06f6e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:21.967408 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-5956e562-b5a3-4c9b-a357-00517f06f6e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:21.974816 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5956e562-b5a3-4c9b-a357-00517f06f6e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:21.975384 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5956e562-b5a3-4c9b-a357-00517f06f6e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:21.976406 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5956e562-b5a3-4c9b-a357-00517f06f6e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:21.976981 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5956e562-b5a3-4c9b-a357-00517f06f6e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:22.119438 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-5956e562-b5a3-4c9b-a357-00517f06f6e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:22.132950 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-5956e562-b5a3-4c9b-a357-00517f06f6e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:22.135592 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-5956e562-b5a3-4c9b-a357-00517f06f6e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:22.137412 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-5956e562-b5a3-4c9b-a357-00517f06f6e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1731 microversion: 2.20 time: 0.174453 Jun 24 09:48:22.137977 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 403/787] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:21 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:48:23.019342 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-a5ea654f-3232-4f29-bb08-31bb6580cec4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8e0e308-3326-47a1-90dc-826c7fef33bf"}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:48:23.020794 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-a5ea654f-3232-4f29-bb08-31bb6580cec4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:23.027662 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a5ea654f-3232-4f29-bb08-31bb6580cec4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:23.028214 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a5ea654f-3232-4f29-bb08-31bb6580cec4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:23.029112 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a5ea654f-3232-4f29-bb08-31bb6580cec4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:23.029678 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a5ea654f-3232-4f29-bb08-31bb6580cec4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:23.032646 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:23.158370 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-ed70c463-63a3-413a-8595-b42008a90e65 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:23.160162 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-ed70c463-63a3-413a-8595-b42008a90e65 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:23.167384 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ed70c463-63a3-413a-8595-b42008a90e65 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:23.167862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ed70c463-63a3-413a-8595-b42008a90e65 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:23.169286 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ed70c463-63a3-413a-8595-b42008a90e65 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:23.169378 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ed70c463-63a3-413a-8595-b42008a90e65 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:23.320661 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-a5ea654f-3232-4f29-bb08-31bb6580cec4 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "POST /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304985 Jun 24 09:48:23.321688 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 385/788] 10.222.0.65 () {60 vars in 1322 bytes} [Fri Jun 24 09:48:23 2022] POST /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:48:23.328714 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ed70c463-63a3-413a-8595-b42008a90e65 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:23.337633 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ed70c463-63a3-413a-8595-b42008a90e65 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:23.339399 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ed70c463-63a3-413a-8595-b42008a90e65 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:23.340762 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-ed70c463-63a3-413a-8595-b42008a90e65 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1731 microversion: 2.20 time: 0.187195 Jun 24 09:48:23.341319 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 404/789] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:23 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:48:24.360517 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-8f1e5cf3-7ea6-4e06-9d0c-9bbc4b91c844 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:24.361381 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-8f1e5cf3-7ea6-4e06-9d0c-9bbc4b91c844 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:24.368805 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8f1e5cf3-7ea6-4e06-9d0c-9bbc4b91c844 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:24.369250 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8f1e5cf3-7ea6-4e06-9d0c-9bbc4b91c844 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:24.370032 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8f1e5cf3-7ea6-4e06-9d0c-9bbc4b91c844 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:24.370472 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8f1e5cf3-7ea6-4e06-9d0c-9bbc4b91c844 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:24.528639 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-8f1e5cf3-7ea6-4e06-9d0c-9bbc4b91c844 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:24.536778 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-8f1e5cf3-7ea6-4e06-9d0c-9bbc4b91c844 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:24.538285 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-8f1e5cf3-7ea6-4e06-9d0c-9bbc4b91c844 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:24.539487 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-8f1e5cf3-7ea6-4e06-9d0c-9bbc4b91c844 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1731 microversion: 2.20 time: 0.183386 Jun 24 09:48:24.540294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 386/790] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:24 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:48:25.441862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-95360fbd-5c33-4e01-82be-8e1e8feb7248 req-5b96d6f0-1d8d-4572-8d9b-7cd6e3e4abec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661", "name": "network-vif-plugged", "status": "completed", "tag": "6a505089-ab65-4375-b6e7-fc2f8ad2fb21"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:48:25.450996 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-95360fbd-5c33-4e01-82be-8e1e8feb7248 req-5b96d6f0-1d8d-4572-8d9b-7cd6e3e4abec service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:25.451466 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-95360fbd-5c33-4e01-82be-8e1e8feb7248 req-5b96d6f0-1d8d-4572-8d9b-7cd6e3e4abec service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:25.465073 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-95360fbd-5c33-4e01-82be-8e1e8feb7248 req-5b96d6f0-1d8d-4572-8d9b-7cd6e3e4abec service nova] Creating event network-vif-plugged:6a505089-ab65-4375-b6e7-fc2f8ad2fb21 for instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 on hv-cinder-80382 Jun 24 09:48:25.470952 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-95360fbd-5c33-4e01-82be-8e1e8feb7248 req-5b96d6f0-1d8d-4572-8d9b-7cd6e3e4abec service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033327 Jun 24 09:48:25.471749 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 405/791] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:48:25.558652 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-4fa4e3f4-a1b0-4ee5-ba75-ada914a458d1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:25.559347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-4fa4e3f4-a1b0-4ee5-ba75-ada914a458d1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:25.566405 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-4fa4e3f4-a1b0-4ee5-ba75-ada914a458d1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:25.566859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-4fa4e3f4-a1b0-4ee5-ba75-ada914a458d1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:25.567778 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-4fa4e3f4-a1b0-4ee5-ba75-ada914a458d1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:25.569679 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-4fa4e3f4-a1b0-4ee5-ba75-ada914a458d1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:25.769903 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-4fa4e3f4-a1b0-4ee5-ba75-ada914a458d1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:25.778536 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-4fa4e3f4-a1b0-4ee5-ba75-ada914a458d1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:25.780144 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-4fa4e3f4-a1b0-4ee5-ba75-ada914a458d1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:25.781351 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-4fa4e3f4-a1b0-4ee5-ba75-ada914a458d1 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1731 microversion: 2.20 time: 0.226808 Jun 24 09:48:25.781909 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 387/792] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:25 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1731 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:48:26.801740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-681b12e0-05cf-4abe-81d1-de225da240b3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:26.802427 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-681b12e0-05cf-4abe-81d1-de225da240b3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:26.809834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-681b12e0-05cf-4abe-81d1-de225da240b3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:26.810187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-681b12e0-05cf-4abe-81d1-de225da240b3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:26.810943 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-681b12e0-05cf-4abe-81d1-de225da240b3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:26.811388 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-681b12e0-05cf-4abe-81d1-de225da240b3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:26.948554 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-681b12e0-05cf-4abe-81d1-de225da240b3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:26.956906 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-681b12e0-05cf-4abe-81d1-de225da240b3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:26.958438 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-681b12e0-05cf-4abe-81d1-de225da240b3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:26.959796 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-681b12e0-05cf-4abe-81d1-de225da240b3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1731 microversion: 2.20 time: 0.162916 Jun 24 09:48:26.960519 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 406/793] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:26 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:48:27.983493 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-e1e0653e-7b24-4045-8ac2-b6699ed937f9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:27.984488 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-e1e0653e-7b24-4045-8ac2-b6699ed937f9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:27.994775 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e1e0653e-7b24-4045-8ac2-b6699ed937f9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:27.995257 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e1e0653e-7b24-4045-8ac2-b6699ed937f9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:27.996020 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e1e0653e-7b24-4045-8ac2-b6699ed937f9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:27.996440 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e1e0653e-7b24-4045-8ac2-b6699ed937f9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:28.145135 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-e1e0653e-7b24-4045-8ac2-b6699ed937f9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:28.153596 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-e1e0653e-7b24-4045-8ac2-b6699ed937f9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:28.155103 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-e1e0653e-7b24-4045-8ac2-b6699ed937f9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:28.156299 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-e1e0653e-7b24-4045-8ac2-b6699ed937f9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1718 microversion: 2.20 time: 0.180120 Jun 24 09:48:28.156869 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 388/794] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:48:27 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1718 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:48:29.928405 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-fd43b080-5290-4b52-9292-06fd1acb7879 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:29.928911 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-fd43b080-5290-4b52-9292-06fd1acb7879 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:29.935937 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fd43b080-5290-4b52-9292-06fd1acb7879 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:29.936388 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fd43b080-5290-4b52-9292-06fd1acb7879 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:29.937120 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fd43b080-5290-4b52-9292-06fd1acb7879 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:29.937545 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fd43b080-5290-4b52-9292-06fd1acb7879 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:30.044595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.objects.instance [None req-fd43b080-5290-4b52-9292-06fd1acb7879 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lazy-loading 'services' on Instance uuid 21ad568e-23cd-4785-ac2f-89601b02e8cb {{(pid=124339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:48:30.126019 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-fd43b080-5290-4b52-9292-06fd1acb7879 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "DELETE /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb/os-volume_attachments/d8e0e308-3326-47a1-90dc-826c7fef33bf" status: 202 len: 0 microversion: 2.1 time: 0.201436 Jun 24 09:48:30.126697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 407/795] 10.222.0.65 () {58 vars in 1415 bytes} [Fri Jun 24 09:48:29 2022] DELETE /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb/os-volume_attachments/d8e0e308-3326-47a1-90dc-826c7fef33bf => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:48:30.135295 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7b0e9c50-6029-476f-93bd-5c5b19dbe9af tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:30.136300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-7b0e9c50-6029-476f-93bd-5c5b19dbe9af tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:30.143607 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7b0e9c50-6029-476f-93bd-5c5b19dbe9af tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:30.144072 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7b0e9c50-6029-476f-93bd-5c5b19dbe9af tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:30.144843 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7b0e9c50-6029-476f-93bd-5c5b19dbe9af tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:30.145301 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-7b0e9c50-6029-476f-93bd-5c5b19dbe9af tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:30.177168 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-7b0e9c50-6029-476f-93bd-5c5b19dbe9af tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045915 Jun 24 09:48:30.177725 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 389/796] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:48:30 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:48:31.190657 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-360af511-9518-434b-ab72-f9db45ce6d65 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:31.191741 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-360af511-9518-434b-ab72-f9db45ce6d65 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:31.199176 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-360af511-9518-434b-ab72-f9db45ce6d65 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:31.199625 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-360af511-9518-434b-ab72-f9db45ce6d65 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:31.200694 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-360af511-9518-434b-ab72-f9db45ce6d65 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:31.201140 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-360af511-9518-434b-ab72-f9db45ce6d65 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:31.231570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-360af511-9518-434b-ab72-f9db45ce6d65 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045882 Jun 24 09:48:31.232491 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 408/797] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:48:31 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 09:48:31.290130 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-97127e3b-2899-4a7f-aa72-c0f528481866 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:31.290672 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-97127e3b-2899-4a7f-aa72-c0f528481866 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:31.297616 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-97127e3b-2899-4a7f-aa72-c0f528481866 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:31.298049 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-97127e3b-2899-4a7f-aa72-c0f528481866 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:31.298822 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-97127e3b-2899-4a7f-aa72-c0f528481866 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:31.299293 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-97127e3b-2899-4a7f-aa72-c0f528481866 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:31.328197 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-97127e3b-2899-4a7f-aa72-c0f528481866 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Going to try to terminate instance {{(pid=124338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:48:31.422547 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-97127e3b-2899-4a7f-aa72-c0f528481866 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "DELETE /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb" status: 204 len: 0 microversion: 2.1 time: 0.135473 Jun 24 09:48:31.423178 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 390/798] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:48:31 2022] DELETE /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:48:31.432784 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4b55502f-d33c-4b46-b3fb-6ba50f5f4b4d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:31.433435 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-4b55502f-d33c-4b46-b3fb-6ba50f5f4b4d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:31.439915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4b55502f-d33c-4b46-b3fb-6ba50f5f4b4d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:31.440374 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4b55502f-d33c-4b46-b3fb-6ba50f5f4b4d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:31.441142 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4b55502f-d33c-4b46-b3fb-6ba50f5f4b4d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:31.441575 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4b55502f-d33c-4b46-b3fb-6ba50f5f4b4d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:31.457327 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:31.578146 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4b55502f-d33c-4b46-b3fb-6ba50f5f4b4d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:31.586570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-4b55502f-d33c-4b46-b3fb-6ba50f5f4b4d tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb" status: 200 len: 1681 microversion: 2.1 time: 0.158141 Jun 24 09:48:31.587148 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 409/799] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:48:31 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:48:32.604781 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-6c773530-0acd-4c26-af82-7f7c31338e64 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:32.605506 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-6c773530-0acd-4c26-af82-7f7c31338e64 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:32.612198 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6c773530-0acd-4c26-af82-7f7c31338e64 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:32.612869 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6c773530-0acd-4c26-af82-7f7c31338e64 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:32.613629 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6c773530-0acd-4c26-af82-7f7c31338e64 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:32.614055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6c773530-0acd-4c26-af82-7f7c31338e64 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:32.747307 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-6c773530-0acd-4c26-af82-7f7c31338e64 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:32.755267 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-6c773530-0acd-4c26-af82-7f7c31338e64 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb" status: 200 len: 1681 microversion: 2.1 time: 0.154817 Jun 24 09:48:32.755854 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 391/800] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:48:32 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:48:33.772760 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-56587fc8-d09a-4d0f-b17c-3da492f05785 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:33.773661 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-56587fc8-d09a-4d0f-b17c-3da492f05785 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:33.776117 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=36 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:33.782695 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-56587fc8-d09a-4d0f-b17c-3da492f05785 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:33.783330 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-56587fc8-d09a-4d0f-b17c-3da492f05785 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:33.784141 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-56587fc8-d09a-4d0f-b17c-3da492f05785 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:33.784686 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-56587fc8-d09a-4d0f-b17c-3da492f05785 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:33.872342 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-56587fc8-d09a-4d0f-b17c-3da492f05785 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd136fcda9a04a16b258301a86bde8ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30033ce42b5a43b78dde38163831cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:48:33.885399 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-56587fc8-d09a-4d0f-b17c-3da492f05785 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb" status: 200 len: 1614 microversion: 2.1 time: 0.117156 Jun 24 09:48:33.887238 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 410/801] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:48:33 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb => generated 1614 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:48:34.072418 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-9d07af97-7489-4040-bb70-ac7bca14e674 req-4710cd7a-1171-4116-a5d5-df0748172253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ad568e-23cd-4785-ac2f-89601b02e8cb", "name": "network-vif-deleted", "tag": "a767a0b3-c7d0-4fd0-895f-6d471a89e711"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:48:34.086948 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-9d07af97-7489-4040-bb70-ac7bca14e674 req-4710cd7a-1171-4116-a5d5-df0748172253 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:34.087696 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-9d07af97-7489-4040-bb70-ac7bca14e674 req-4710cd7a-1171-4116-a5d5-df0748172253 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:34.101839 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-9d07af97-7489-4040-bb70-ac7bca14e674 req-4710cd7a-1171-4116-a5d5-df0748172253 service nova] Creating event network-vif-deleted:a767a0b3-c7d0-4fd0-895f-6d471a89e711 for instance 21ad568e-23cd-4785-ac2f-89601b02e8cb on hv-cinder-80382 Jun 24 09:48:34.109596 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-9d07af97-7489-4040-bb70-ac7bca14e674 req-4710cd7a-1171-4116-a5d5-df0748172253 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046506 Jun 24 09:48:34.110945 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 392/802] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:48:34.902923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7a9231eb-2e6c-4aea-acc1-24fa53cd87b2 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:34.903558 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-7a9231eb-2e6c-4aea-acc1-24fa53cd87b2 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:34.911610 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7a9231eb-2e6c-4aea-acc1-24fa53cd87b2 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:34.912118 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7a9231eb-2e6c-4aea-acc1-24fa53cd87b2 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:34.913201 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7a9231eb-2e6c-4aea-acc1-24fa53cd87b2 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:34.913724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7a9231eb-2e6c-4aea-acc1-24fa53cd87b2 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:34.935821 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-7a9231eb-2e6c-4aea-acc1-24fa53cd87b2 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] HTTP exception thrown: Instance 21ad568e-23cd-4785-ac2f-89601b02e8cb could not be found. Jun 24 09:48:34.937595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7a9231eb-2e6c-4aea-acc1-24fa53cd87b2 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Request method failure captured: Jun 24 09:48:34.937595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb HTTP/1.1 Jun 24 09:48:34.937595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:48:34.937595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:48:34.937595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:48:34.937595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:48:34.937595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:48:34.937595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:48:34.937595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:48:34.937595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:48:34.937595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYbvJ3i86IfpBOV1GhbK6BjjMPGc6Tm1uaFsF_cm2jflXXzg3yQgcdVgGx8TFBVweDptNaGL-vvoreBeBGl_GS39sHCNfkE3V7sePQxiYoI7e3NRcV5C6bE6H-sdZ6Daa5bOcdZzQqk3HMpLiyCtZEkhPHZ6MJeA9vI9pz9NKdB8VSk Jun 24 09:48:34.937595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:48:34.937595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:48:34.937595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:48:34.937595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:48:34.937595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:48:34.937595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:48:34.937595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:48:34.937595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:34.937595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:48:34.937595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:48:34.939275 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_30033ce42b5a43b78dde38163831cea2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:48:34.939275 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:34.939275 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:48:34.939275 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:34.939275 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:48:34.939275 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:48:34.939275 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:48:34.939275 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: fd136fcda9a04a16b258301a86bde8ef Jun 24 09:48:34.939275 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:48:34.939275 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:48:34.939275 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance 21ad568e-23cd-4785-ac2f-89601b02e8cb could not be found. Jun 24 09:48:34.939275 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': '21ad568e-23cd-4785-ac2f-89601b02e8cb'} Jun 24 09:48:34.940187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:48:34.940187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:34.940187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:48:34.940187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:48:34.940187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:48:34.940187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:48:34.940187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:48:34.940187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:48:34.940187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:48:34.940187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:48:34.940187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21ad568e-23cd-4785-ac2f-89601b02e8cb could not be found. Jun 24 09:48:34.940187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:34.940187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:34.940187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:34.940187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:34.940187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:34.940187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:34.940187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:48:34.940187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:48:34.940187 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:48:34.941670 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:48:34.941670 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:48:34.941670 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:48:34.941670 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:48:34.941670 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:48:34.941670 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:48:34.941670 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:48:34.941670 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21ad568e-23cd-4785-ac2f-89601b02e8cb could not be found. Jun 24 09:48:34.941670 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:34.941670 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:34.941670 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:34.941670 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:34.941670 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:34.941670 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:34.941670 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:48:34.941670 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:48:34.941670 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21ad568e-23cd-4785-ac2f-89601b02e8cb could not be found. Jun 24 09:48:34.941670 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:34.948069 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7a9231eb-2e6c-4aea-acc1-24fa53cd87b2 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Returning 404 to user: Instance 21ad568e-23cd-4785-ac2f-89601b02e8cb could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:48:34.949169 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-7a9231eb-2e6c-4aea-acc1-24fa53cd87b2 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb" status: 404 len: 111 microversion: 2.1 time: 0.051084 Jun 24 09:48:34.951007 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 411/803] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:48:34 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:48:34.959607 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-a2464b2b-8f8a-4fc1-9ddd-b85d2a3d9794 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '.version_select at 0x7fc6d4cf6c10>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:34.980965 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-a2464b2b-8f8a-4fc1-9ddd-b85d2a3d9794 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1020995696" status: 202 len: 0 microversion: 2.1 time: 0.025573 Jun 24 09:48:34.981676 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 393/804] 10.222.0.65 () {58 vars in 1220 bytes} [Fri Jun 24 09:48:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1020995696 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:48:36.932367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1f6d211d-8a15-42da-bf71-39cdd3246d00 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:36.933112 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-1f6d211d-8a15-42da-bf71-39cdd3246d00 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:36.940316 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1f6d211d-8a15-42da-bf71-39cdd3246d00 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:36.940765 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1f6d211d-8a15-42da-bf71-39cdd3246d00 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:36.941540 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1f6d211d-8a15-42da-bf71-39cdd3246d00 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:36.941967 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1f6d211d-8a15-42da-bf71-39cdd3246d00 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:36.960438 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-1f6d211d-8a15-42da-bf71-39cdd3246d00 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] HTTP exception thrown: Instance 21ad568e-23cd-4785-ac2f-89601b02e8cb could not be found. Jun 24 09:48:36.962367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1f6d211d-8a15-42da-bf71-39cdd3246d00 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Request method failure captured: Jun 24 09:48:36.962367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: DELETE /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb HTTP/1.1 Jun 24 09:48:36.962367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:48:36.962367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:48:36.962367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:48:36.962367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:48:36.962367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:48:36.962367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:48:36.962367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:48:36.962367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:48:36.962367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYbvJ3i86IfpBOV1GhbK6BjjMPGc6Tm1uaFsF_cm2jflXXzg3yQgcdVgGx8TFBVweDptNaGL-vvoreBeBGl_GS39sHCNfkE3V7sePQxiYoI7e3NRcV5C6bE6H-sdZ6Daa5bOcdZzQqk3HMpLiyCtZEkhPHZ6MJeA9vI9pz9NKdB8VSk Jun 24 09:48:36.962367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:48:36.962367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:48:36.962367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:48:36.962367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:48:36.962367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:48:36.962367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:48:36.962367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:48:36.962367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:36.962367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:48:36.962367 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:48:36.963984 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_30033ce42b5a43b78dde38163831cea2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:48:36.963984 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:36.963984 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:48:36.963984 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:36.963984 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:48:36.963984 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:48:36.963984 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:48:36.963984 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: fd136fcda9a04a16b258301a86bde8ef Jun 24 09:48:36.963984 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:48:36.963984 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:48:36.963984 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance 21ad568e-23cd-4785-ac2f-89601b02e8cb could not be found. Jun 24 09:48:36.963984 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': '21ad568e-23cd-4785-ac2f-89601b02e8cb'} Jun 24 09:48:36.964859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:48:36.964859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:36.964859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:48:36.964859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:48:36.964859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:48:36.964859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:48:36.964859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:48:36.964859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:48:36.964859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:48:36.964859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:48:36.964859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21ad568e-23cd-4785-ac2f-89601b02e8cb could not be found. Jun 24 09:48:36.964859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:36.964859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:36.964859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:36.964859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:36.964859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:36.964859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:36.964859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:48:36.964859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:48:36.964859 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:48:36.967126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:48:36.967126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 09:48:36.967126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 09:48:36.967126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 09:48:36.967126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 09:48:36.967126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:48:36.967126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:48:36.967126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:48:36.967126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:48:36.967126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21ad568e-23cd-4785-ac2f-89601b02e8cb could not be found. Jun 24 09:48:36.967126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:36.967126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:36.967126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:36.967126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:36.967126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:36.967126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:36.967126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:48:36.967126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:48:36.967126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21ad568e-23cd-4785-ac2f-89601b02e8cb could not be found. Jun 24 09:48:36.967126 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:36.969947 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1f6d211d-8a15-42da-bf71-39cdd3246d00 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Returning 404 to user: Instance 21ad568e-23cd-4785-ac2f-89601b02e8cb could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:48:36.971837 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-1f6d211d-8a15-42da-bf71-39cdd3246d00 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "DELETE /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb" status: 404 len: 111 microversion: 2.1 time: 0.051105 Jun 24 09:48:36.972754 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 412/805] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:48:36 2022] DELETE /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:48:36.982413 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-837c017d-949a-4c4c-9dd4-b830e2b367a1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:36.983296 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-837c017d-949a-4c4c-9dd4-b830e2b367a1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 21ad568e-23cd-4785-ac2f-89601b02e8cb] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:36.989691 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-837c017d-949a-4c4c-9dd4-b830e2b367a1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:36.990262 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-837c017d-949a-4c4c-9dd4-b830e2b367a1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:36.991517 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-837c017d-949a-4c4c-9dd4-b830e2b367a1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:36.992242 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-837c017d-949a-4c4c-9dd4-b830e2b367a1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:37.009974 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.wsgi [None req-837c017d-949a-4c4c-9dd4-b830e2b367a1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] HTTP exception thrown: Instance 21ad568e-23cd-4785-ac2f-89601b02e8cb could not be found. Jun 24 09:48:37.011978 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-837c017d-949a-4c4c-9dd4-b830e2b367a1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Request method failure captured: Jun 24 09:48:37.011978 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb HTTP/1.1 Jun 24 09:48:37.011978 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:48:37.011978 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:48:37.011978 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:48:37.011978 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 0 Jun 24 09:48:37.011978 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:48:37.011978 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:48:37.011978 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:48:37.011978 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:48:37.011978 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYbvJ3i86IfpBOV1GhbK6BjjMPGc6Tm1uaFsF_cm2jflXXzg3yQgcdVgGx8TFBVweDptNaGL-vvoreBeBGl_GS39sHCNfkE3V7sePQxiYoI7e3NRcV5C6bE6H-sdZ6Daa5bOcdZzQqk3HMpLiyCtZEkhPHZ6MJeA9vI9pz9NKdB8VSk Jun 24 09:48:37.011978 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:48:37.011978 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:48:37.011978 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:48:37.011978 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:48:37.011978 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:48:37.011978 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:48:37.011978 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:48:37.011978 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:37.011978 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:48:37.011978 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:48:37.013504 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_30033ce42b5a43b78dde38163831cea2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:48:37.013504 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:37.013504 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:48:37.013504 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:37.013504 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:48:37.013504 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:48:37.013504 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:48:37.013504 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: fd136fcda9a04a16b258301a86bde8ef Jun 24 09:48:37.013504 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:48:37.013504 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: > Jun 24 09:48:37.013504 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Instance 21ad568e-23cd-4785-ac2f-89601b02e8cb could not be found. Jun 24 09:48:37.013504 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'id': '21ad568e-23cd-4785-ac2f-89601b02e8cb'} Jun 24 09:48:37.014223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:48:37.014223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:37.014223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:48:37.014223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:48:37.014223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:48:37.014223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:48:37.014223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:48:37.014223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:48:37.014223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:48:37.014223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:48:37.014223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21ad568e-23cd-4785-ac2f-89601b02e8cb could not be found. Jun 24 09:48:37.014223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:37.014223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:37.014223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:37.014223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:37.014223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:37.014223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:37.014223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:48:37.014223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:48:37.014223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:48:37.016434 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:48:37.016434 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:48:37.016434 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:48:37.016434 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:48:37.016434 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:48:37.016434 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:48:37.016434 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:48:37.016434 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21ad568e-23cd-4785-ac2f-89601b02e8cb could not be found. Jun 24 09:48:37.016434 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:37.016434 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:37.016434 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:37.016434 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:37.016434 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:37.016434 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:37.016434 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:48:37.016434 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:48:37.016434 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21ad568e-23cd-4785-ac2f-89601b02e8cb could not be found. Jun 24 09:48:37.016434 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:37.019417 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-837c017d-949a-4c4c-9dd4-b830e2b367a1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Returning 404 to user: Instance 21ad568e-23cd-4785-ac2f-89601b02e8cb could not be found. {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:48:37.020477 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-837c017d-949a-4c4c-9dd4-b830e2b367a1 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb" status: 404 len: 111 microversion: 2.1 time: 0.043360 Jun 24 09:48:37.021234 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 394/806] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:48:36 2022] GET /compute/v2.1/servers/21ad568e-23cd-4785-ac2f-89601b02e8cb => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:48:38.181621 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-705d4978-3ef3-4280-b050-b66a2aaa7c2f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:38.182131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-705d4978-3ef3-4280-b050-b66a2aaa7c2f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:38.193999 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-705d4978-3ef3-4280-b050-b66a2aaa7c2f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:38.194610 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-705d4978-3ef3-4280-b050-b66a2aaa7c2f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:38.195649 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-705d4978-3ef3-4280-b050-b66a2aaa7c2f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:38.196346 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-705d4978-3ef3-4280-b050-b66a2aaa7c2f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:38.215879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-705d4978-3ef3-4280-b050-b66a2aaa7c2f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] HTTP exception thrown: Instance e892f2df-f3bb-4a2d-8152-4bc170cff4b3 could not be found. Jun 24 09:48:38.217461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-705d4978-3ef3-4280-b050-b66a2aaa7c2f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Request method failure captured: Jun 24 09:48:38.217461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: DELETE /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 HTTP/1.1 Jun 24 09:48:38.217461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:48:38.217461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:48:38.217461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:48:38.217461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:48:38.217461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:48:38.217461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:48:38.217461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:48:38.217461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:48:38.217461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYbvJ3i86IfpBOV1GhbK6BjjMPGc6Tm1uaFsF_cm2jflXXzg3yQgcdVgGx8TFBVweDptNaGL-vvoreBeBGl_GS39sHCNfkE3V7sePQxiYoI7e3NRcV5C6bE6H-sdZ6Daa5bOcdZzQqk3HMpLiyCtZEkhPHZ6MJeA9vI9pz9NKdB8VSk Jun 24 09:48:38.217461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:48:38.217461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:48:38.217461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:48:38.217461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:48:38.217461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:48:38.217461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:48:38.217461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:48:38.217461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:38.217461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:48:38.217461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:48:38.219161 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_30033ce42b5a43b78dde38163831cea2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:48:38.219161 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:38.219161 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:48:38.219161 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:38.219161 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:48:38.219161 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:48:38.219161 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:48:38.219161 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: fd136fcda9a04a16b258301a86bde8ef Jun 24 09:48:38.219161 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:48:38.219161 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:48:38.219161 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance e892f2df-f3bb-4a2d-8152-4bc170cff4b3 could not be found. Jun 24 09:48:38.219161 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': 'e892f2df-f3bb-4a2d-8152-4bc170cff4b3'} Jun 24 09:48:38.219876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:48:38.219876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:38.219876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:48:38.219876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:48:38.219876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:48:38.219876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:48:38.219876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:48:38.219876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:48:38.219876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:48:38.219876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:48:38.219876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e892f2df-f3bb-4a2d-8152-4bc170cff4b3 could not be found. Jun 24 09:48:38.219876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:38.219876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:38.219876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:38.219876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:38.219876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:38.219876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:38.219876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:48:38.219876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:48:38.219876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:48:38.221011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:48:38.221011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 09:48:38.221011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 09:48:38.221011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 09:48:38.221011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 09:48:38.221011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:48:38.221011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:48:38.221011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:48:38.221011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:48:38.221011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e892f2df-f3bb-4a2d-8152-4bc170cff4b3 could not be found. Jun 24 09:48:38.221011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:38.221011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:38.221011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:38.221011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:38.221011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:38.221011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:38.221011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:48:38.221011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:48:38.221011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e892f2df-f3bb-4a2d-8152-4bc170cff4b3 could not be found. Jun 24 09:48:38.221011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:38.222157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-705d4978-3ef3-4280-b050-b66a2aaa7c2f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Returning 404 to user: Instance e892f2df-f3bb-4a2d-8152-4bc170cff4b3 could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:48:38.222157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-705d4978-3ef3-4280-b050-b66a2aaa7c2f tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3" status: 404 len: 111 microversion: 2.1 time: 0.041665 Jun 24 09:48:38.222157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 413/807] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:48:38 2022] DELETE /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:48:38.227899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-19e16ff9-6474-47dd-a737-7d3a9cfce1ff tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:38.228513 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-19e16ff9-6474-47dd-a737-7d3a9cfce1ff tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: e892f2df-f3bb-4a2d-8152-4bc170cff4b3] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:38.236102 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-19e16ff9-6474-47dd-a737-7d3a9cfce1ff tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:38.236547 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-19e16ff9-6474-47dd-a737-7d3a9cfce1ff tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:38.237307 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-19e16ff9-6474-47dd-a737-7d3a9cfce1ff tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:38.237734 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-19e16ff9-6474-47dd-a737-7d3a9cfce1ff tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:38.255374 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.wsgi [None req-19e16ff9-6474-47dd-a737-7d3a9cfce1ff tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] HTTP exception thrown: Instance e892f2df-f3bb-4a2d-8152-4bc170cff4b3 could not be found. Jun 24 09:48:38.258376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-19e16ff9-6474-47dd-a737-7d3a9cfce1ff tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Request method failure captured: Jun 24 09:48:38.258376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 HTTP/1.1 Jun 24 09:48:38.258376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:48:38.258376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:48:38.258376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:48:38.258376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 0 Jun 24 09:48:38.258376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:48:38.258376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:48:38.258376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:48:38.258376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:48:38.258376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYbvJ3i86IfpBOV1GhbK6BjjMPGc6Tm1uaFsF_cm2jflXXzg3yQgcdVgGx8TFBVweDptNaGL-vvoreBeBGl_GS39sHCNfkE3V7sePQxiYoI7e3NRcV5C6bE6H-sdZ6Daa5bOcdZzQqk3HMpLiyCtZEkhPHZ6MJeA9vI9pz9NKdB8VSk Jun 24 09:48:38.258376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:48:38.258376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:48:38.258376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:48:38.258376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:48:38.258376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:48:38.258376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:48:38.258376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:48:38.258376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:38.258376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:48:38.258376 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:48:38.259722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_30033ce42b5a43b78dde38163831cea2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:48:38.259722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:38.259722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:48:38.259722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:38.259722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:48:38.259722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:48:38.259722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:48:38.259722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: fd136fcda9a04a16b258301a86bde8ef Jun 24 09:48:38.259722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:48:38.259722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: > Jun 24 09:48:38.259722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Instance e892f2df-f3bb-4a2d-8152-4bc170cff4b3 could not be found. Jun 24 09:48:38.259722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'id': 'e892f2df-f3bb-4a2d-8152-4bc170cff4b3'} Jun 24 09:48:38.260476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:48:38.260476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:38.260476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:48:38.260476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:48:38.260476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:48:38.260476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:48:38.260476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:48:38.260476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:48:38.260476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:48:38.260476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:48:38.260476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e892f2df-f3bb-4a2d-8152-4bc170cff4b3 could not be found. Jun 24 09:48:38.260476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:38.260476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:38.260476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:38.260476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:38.260476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:38.260476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:38.260476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:48:38.260476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:48:38.260476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:48:38.264226 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:48:38.264226 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:48:38.264226 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:48:38.264226 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:48:38.264226 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:48:38.264226 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:48:38.264226 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:48:38.264226 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e892f2df-f3bb-4a2d-8152-4bc170cff4b3 could not be found. Jun 24 09:48:38.264226 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:38.264226 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:38.264226 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:38.264226 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:38.264226 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:38.264226 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:38.264226 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:48:38.264226 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:48:38.264226 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e892f2df-f3bb-4a2d-8152-4bc170cff4b3 could not be found. Jun 24 09:48:38.264226 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:38.265453 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-19e16ff9-6474-47dd-a737-7d3a9cfce1ff tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Returning 404 to user: Instance e892f2df-f3bb-4a2d-8152-4bc170cff4b3 could not be found. {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:48:38.265453 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-19e16ff9-6474-47dd-a737-7d3a9cfce1ff tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3" status: 404 len: 111 microversion: 2.1 time: 0.036321 Jun 24 09:48:38.265453 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 395/808] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:48:38 2022] GET /compute/v2.1/servers/e892f2df-f3bb-4a2d-8152-4bc170cff4b3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:48:38.270720 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-66ecc54b-13c0-47dd-8314-1e2a62c00812 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:38.271327 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-66ecc54b-13c0-47dd-8314-1e2a62c00812 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:38.282606 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-66ecc54b-13c0-47dd-8314-1e2a62c00812 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:38.283176 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-66ecc54b-13c0-47dd-8314-1e2a62c00812 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:38.284043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-66ecc54b-13c0-47dd-8314-1e2a62c00812 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:38.284575 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-66ecc54b-13c0-47dd-8314-1e2a62c00812 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:38.300831 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-66ecc54b-13c0-47dd-8314-1e2a62c00812 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] HTTP exception thrown: Instance 67719189-e3da-4e2f-99cd-a136ece74789 could not be found. Jun 24 09:48:38.302732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-66ecc54b-13c0-47dd-8314-1e2a62c00812 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Request method failure captured: Jun 24 09:48:38.302732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: DELETE /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 HTTP/1.1 Jun 24 09:48:38.302732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:48:38.302732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:48:38.302732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:48:38.302732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:48:38.302732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:48:38.302732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:48:38.302732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:48:38.302732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:48:38.302732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYbvJ3i86IfpBOV1GhbK6BjjMPGc6Tm1uaFsF_cm2jflXXzg3yQgcdVgGx8TFBVweDptNaGL-vvoreBeBGl_GS39sHCNfkE3V7sePQxiYoI7e3NRcV5C6bE6H-sdZ6Daa5bOcdZzQqk3HMpLiyCtZEkhPHZ6MJeA9vI9pz9NKdB8VSk Jun 24 09:48:38.302732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:48:38.302732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:48:38.302732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:48:38.302732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:48:38.302732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:48:38.302732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:48:38.302732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:48:38.302732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:38.302732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:48:38.302732 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:48:38.304240 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_30033ce42b5a43b78dde38163831cea2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:48:38.304240 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:38.304240 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:48:38.304240 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:38.304240 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:48:38.304240 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:48:38.304240 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:48:38.304240 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: fd136fcda9a04a16b258301a86bde8ef Jun 24 09:48:38.304240 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:48:38.304240 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:48:38.304240 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance 67719189-e3da-4e2f-99cd-a136ece74789 could not be found. Jun 24 09:48:38.304240 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': '67719189-e3da-4e2f-99cd-a136ece74789'} Jun 24 09:48:38.305040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:48:38.305040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:38.305040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:48:38.305040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:48:38.305040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:48:38.305040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:48:38.305040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:48:38.305040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:48:38.305040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:48:38.305040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:48:38.305040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67719189-e3da-4e2f-99cd-a136ece74789 could not be found. Jun 24 09:48:38.305040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:38.305040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:38.305040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:38.305040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:38.305040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:38.305040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:38.305040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:48:38.305040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:48:38.305040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:48:38.306587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:48:38.306587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 09:48:38.306587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 09:48:38.306587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 09:48:38.306587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 09:48:38.306587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:48:38.306587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:48:38.306587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:48:38.306587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:48:38.306587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67719189-e3da-4e2f-99cd-a136ece74789 could not be found. Jun 24 09:48:38.306587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:38.306587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:38.306587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:38.306587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:38.306587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:38.306587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:38.306587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:48:38.306587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:48:38.306587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67719189-e3da-4e2f-99cd-a136ece74789 could not be found. Jun 24 09:48:38.306587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:38.308634 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-66ecc54b-13c0-47dd-8314-1e2a62c00812 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Returning 404 to user: Instance 67719189-e3da-4e2f-99cd-a136ece74789 could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:48:38.308634 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-66ecc54b-13c0-47dd-8314-1e2a62c00812 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "DELETE /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 404 len: 111 microversion: 2.1 time: 0.037675 Jun 24 09:48:38.310620 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 414/809] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:48:38 2022] DELETE /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:48:38.313511 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-235c9a6a-e827-4fd0-84f2-f78506cd2f51 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:38.314137 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-235c9a6a-e827-4fd0-84f2-f78506cd2f51 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 67719189-e3da-4e2f-99cd-a136ece74789] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:38.322176 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-235c9a6a-e827-4fd0-84f2-f78506cd2f51 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:38.322971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-235c9a6a-e827-4fd0-84f2-f78506cd2f51 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:38.323972 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-235c9a6a-e827-4fd0-84f2-f78506cd2f51 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:38.324699 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-235c9a6a-e827-4fd0-84f2-f78506cd2f51 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:38.340619 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.wsgi [None req-235c9a6a-e827-4fd0-84f2-f78506cd2f51 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] HTTP exception thrown: Instance 67719189-e3da-4e2f-99cd-a136ece74789 could not be found. Jun 24 09:48:38.343312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-235c9a6a-e827-4fd0-84f2-f78506cd2f51 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Request method failure captured: Jun 24 09:48:38.343312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 HTTP/1.1 Jun 24 09:48:38.343312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:48:38.343312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:48:38.343312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:48:38.343312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 0 Jun 24 09:48:38.343312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:48:38.343312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:48:38.343312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:48:38.343312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:48:38.343312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYbvJ3i86IfpBOV1GhbK6BjjMPGc6Tm1uaFsF_cm2jflXXzg3yQgcdVgGx8TFBVweDptNaGL-vvoreBeBGl_GS39sHCNfkE3V7sePQxiYoI7e3NRcV5C6bE6H-sdZ6Daa5bOcdZzQqk3HMpLiyCtZEkhPHZ6MJeA9vI9pz9NKdB8VSk Jun 24 09:48:38.343312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:48:38.343312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:48:38.343312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:48:38.343312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:48:38.343312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:48:38.343312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:48:38.343312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:48:38.343312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:38.343312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:48:38.343312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:48:38.344878 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_30033ce42b5a43b78dde38163831cea2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:48:38.344878 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:38.344878 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:48:38.344878 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:38.344878 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:48:38.344878 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:48:38.344878 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:48:38.344878 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: fd136fcda9a04a16b258301a86bde8ef Jun 24 09:48:38.344878 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:48:38.344878 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: > Jun 24 09:48:38.344878 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Instance 67719189-e3da-4e2f-99cd-a136ece74789 could not be found. Jun 24 09:48:38.344878 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'id': '67719189-e3da-4e2f-99cd-a136ece74789'} Jun 24 09:48:38.345797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:48:38.345797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:38.345797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:48:38.345797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:48:38.345797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:48:38.345797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:48:38.345797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:48:38.345797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:48:38.345797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:48:38.345797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:48:38.345797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67719189-e3da-4e2f-99cd-a136ece74789 could not be found. Jun 24 09:48:38.345797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:38.345797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:38.345797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:38.345797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:38.345797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:38.345797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:38.345797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:48:38.345797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:48:38.345797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:48:38.347118 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:48:38.347118 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:48:38.347118 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:48:38.347118 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:48:38.347118 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:48:38.347118 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:48:38.347118 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:48:38.347118 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67719189-e3da-4e2f-99cd-a136ece74789 could not be found. Jun 24 09:48:38.347118 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:38.347118 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:38.347118 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:38.347118 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:38.347118 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:38.347118 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:38.347118 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:48:38.347118 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:48:38.347118 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67719189-e3da-4e2f-99cd-a136ece74789 could not be found. Jun 24 09:48:38.347118 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:38.349167 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-235c9a6a-e827-4fd0-84f2-f78506cd2f51 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Returning 404 to user: Instance 67719189-e3da-4e2f-99cd-a136ece74789 could not be found. {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:48:38.350690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-235c9a6a-e827-4fd0-84f2-f78506cd2f51 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789" status: 404 len: 111 microversion: 2.1 time: 0.041300 Jun 24 09:48:38.351782 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 396/810] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:48:38 2022] GET /compute/v2.1/servers/67719189-e3da-4e2f-99cd-a136ece74789 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 09:48:39.536699 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-68bfa269-75e2-45f0-b7f1-46d2d4697dd8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:39.537255 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-68bfa269-75e2-45f0-b7f1-46d2d4697dd8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:39.548452 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-68bfa269-75e2-45f0-b7f1-46d2d4697dd8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:39.549298 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-68bfa269-75e2-45f0-b7f1-46d2d4697dd8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:39.550633 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-68bfa269-75e2-45f0-b7f1-46d2d4697dd8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:39.553808 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-68bfa269-75e2-45f0-b7f1-46d2d4697dd8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:39.571060 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-68bfa269-75e2-45f0-b7f1-46d2d4697dd8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] HTTP exception thrown: Instance 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef could not be found. Jun 24 09:48:39.572727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-68bfa269-75e2-45f0-b7f1-46d2d4697dd8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Request method failure captured: Jun 24 09:48:39.572727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: DELETE /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef HTTP/1.1 Jun 24 09:48:39.572727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:48:39.572727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:48:39.572727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:48:39.572727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:48:39.572727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:48:39.572727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:48:39.572727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:48:39.572727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:48:39.572727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYbvJ3i86IfpBOV1GhbK6BjjMPGc6Tm1uaFsF_cm2jflXXzg3yQgcdVgGx8TFBVweDptNaGL-vvoreBeBGl_GS39sHCNfkE3V7sePQxiYoI7e3NRcV5C6bE6H-sdZ6Daa5bOcdZzQqk3HMpLiyCtZEkhPHZ6MJeA9vI9pz9NKdB8VSk Jun 24 09:48:39.572727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:48:39.572727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:48:39.572727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:48:39.572727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:48:39.572727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:48:39.572727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:48:39.572727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:48:39.572727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:39.572727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:48:39.572727 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:48:39.574123 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_30033ce42b5a43b78dde38163831cea2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:48:39.574123 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:39.574123 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:48:39.574123 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:39.574123 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:48:39.574123 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:48:39.574123 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:48:39.574123 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: fd136fcda9a04a16b258301a86bde8ef Jun 24 09:48:39.574123 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:48:39.574123 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:48:39.574123 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef could not be found. Jun 24 09:48:39.574123 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': '93a2b7d9-c03a-459b-9ceb-5d6bf14546ef'} Jun 24 09:48:39.574961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:48:39.574961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:39.574961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:48:39.574961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:48:39.574961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:48:39.574961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:48:39.574961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:48:39.574961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:48:39.574961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:48:39.574961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:48:39.574961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef could not be found. Jun 24 09:48:39.574961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:39.574961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:39.574961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:39.574961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:39.574961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:39.574961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:39.574961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:48:39.574961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:48:39.574961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:48:39.577029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:48:39.577029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 09:48:39.577029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 09:48:39.577029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 09:48:39.577029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 09:48:39.577029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:48:39.577029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:48:39.577029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:48:39.577029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:48:39.577029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef could not be found. Jun 24 09:48:39.577029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:39.577029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:39.577029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:39.577029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:39.577029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:39.577029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:39.577029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:48:39.577029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:48:39.577029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef could not be found. Jun 24 09:48:39.577029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:39.580193 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-68bfa269-75e2-45f0-b7f1-46d2d4697dd8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Returning 404 to user: Instance 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:48:39.580193 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-68bfa269-75e2-45f0-b7f1-46d2d4697dd8 tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "DELETE /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 404 len: 111 microversion: 2.1 time: 0.041442 Jun 24 09:48:39.580193 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 415/811] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:48:39 2022] DELETE /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:48:39.584038 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-9eedf760-41e5-47cb-946b-12f5afa5f95b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:39.585503 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-9eedf760-41e5-47cb-946b-12f5afa5f95b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] [instance: 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:48:39.593722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9eedf760-41e5-47cb-946b-12f5afa5f95b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:39.594481 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9eedf760-41e5-47cb-946b-12f5afa5f95b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:39.595430 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9eedf760-41e5-47cb-946b-12f5afa5f95b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:48:39.596134 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9eedf760-41e5-47cb-946b-12f5afa5f95b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:48:39.612129 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.wsgi [None req-9eedf760-41e5-47cb-946b-12f5afa5f95b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] HTTP exception thrown: Instance 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef could not be found. Jun 24 09:48:39.616795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-9eedf760-41e5-47cb-946b-12f5afa5f95b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Request method failure captured: Jun 24 09:48:39.616795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef HTTP/1.1 Jun 24 09:48:39.616795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:48:39.616795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:48:39.616795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:48:39.616795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 0 Jun 24 09:48:39.616795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:48:39.616795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:48:39.616795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:48:39.616795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:48:39.616795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYbvJ3i86IfpBOV1GhbK6BjjMPGc6Tm1uaFsF_cm2jflXXzg3yQgcdVgGx8TFBVweDptNaGL-vvoreBeBGl_GS39sHCNfkE3V7sePQxiYoI7e3NRcV5C6bE6H-sdZ6Daa5bOcdZzQqk3HMpLiyCtZEkhPHZ6MJeA9vI9pz9NKdB8VSk Jun 24 09:48:39.616795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:48:39.616795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:48:39.616795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:48:39.616795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:48:39.616795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:48:39.616795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:48:39.616795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:48:39.616795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:39.616795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:48:39.616795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:48:39.618466 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_30033ce42b5a43b78dde38163831cea2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/30033ce42b5a43b78dde38163831cea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:48:39.618466 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:39.618466 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: 30033ce42b5a43b78dde38163831cea2 Jun 24 09:48:39.618466 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-89945820 Jun 24 09:48:39.618466 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:48:39.618466 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:48:39.618466 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:48:39.618466 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: fd136fcda9a04a16b258301a86bde8ef Jun 24 09:48:39.618466 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-AttachVolumeNegativeTest-89945820-project Jun 24 09:48:39.618466 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: > Jun 24 09:48:39.618466 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Instance 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef could not be found. Jun 24 09:48:39.618466 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'id': '93a2b7d9-c03a-459b-9ceb-5d6bf14546ef'} Jun 24 09:48:39.619410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:48:39.619410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:39.619410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:48:39.619410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:48:39.619410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:48:39.619410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:48:39.619410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:48:39.619410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:48:39.619410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:48:39.619410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:48:39.619410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef could not be found. Jun 24 09:48:39.619410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:39.619410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:39.619410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:39.619410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:39.619410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:39.619410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:39.619410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:48:39.619410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:48:39.619410 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:48:39.620971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:48:39.620971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:48:39.620971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:48:39.620971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:48:39.620971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:48:39.620971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:48:39.620971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:48:39.620971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef could not be found. Jun 24 09:48:39.620971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:39.620971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:39.620971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:39.620971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:39.620971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:39.620971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:39.620971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:48:39.620971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:48:39.620971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef could not be found. Jun 24 09:48:39.620971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:39.622394 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-9eedf760-41e5-47cb-946b-12f5afa5f95b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] Returning 404 to user: Instance 93a2b7d9-c03a-459b-9ceb-5d6bf14546ef could not be found. {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:48:39.623164 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-9eedf760-41e5-47cb-946b-12f5afa5f95b tempest-AttachVolumeNegativeTest-89945820 tempest-AttachVolumeNegativeTest-89945820-project] 10.222.0.65 "GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef" status: 404 len: 111 microversion: 2.1 time: 0.043667 Jun 24 09:48:39.627251 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 397/812] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:48:39 2022] GET /compute/v2.1/servers/93a2b7d9-c03a-459b-9ceb-5d6bf14546ef => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:48:47.093943 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-02d4935f-fb62-40e9-91ff-dcb6e69410e3 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Action: 'create', calling method: .version_select at 0x7fc6d442edc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-853348123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDigx7KBJz30HwEk+n9WoRdG7PMDQYzUMo5dUX5O8vLynDNFLO6cKwwffCJvYpdjMYJjWtCZYlCsdFoTE1j5HGpF4ZRs33y8mON0dEIgxGMYokkaGMwfbAUwe8WuPzJTHw=="}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:48:47.109486 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-02d4935f-fb62-40e9-91ff-dcb6e69410e3 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Getting quotas for project 86f042cb88b7426ea9733f70033b55e3. Resources: {'key_pairs'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:48:47.113551 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-02d4935f-fb62-40e9-91ff-dcb6e69410e3 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Getting quotas for user 565cc9705a94454b9e68595b85c6a286 and project 86f042cb88b7426ea9733f70033b55e3. Resources: {'key_pairs'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:48:47.141357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-02d4935f-fb62-40e9-91ff-dcb6e69410e3 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.326218 Jun 24 09:48:47.142302 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 416/813] 10.222.0.65 () {60 vars in 1158 bytes} [Fri Jun 24 09:48:46 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:48:47.799149 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-dd3294c6-f370-4ced-9f0e-fad031328cc2 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Action: 'create', calling method: .version_select at 0x7fc6d4acf160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-574722854"}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:48:48.263678 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-dd3294c6-f370-4ced-9f0e-fad031328cc2 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.676324 Jun 24 09:48:48.264299 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 398/814] 10.222.0.65 () {60 vars in 1154 bytes} [Fri Jun 24 09:48:47 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 678 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 24 09:48:48.278660 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b8295837-3d7c-4914-9a71-d56f7b155aff tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Calling method '.version_select at 0x7fc6d42838b0>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:48.353588 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b8295837-3d7c-4914-9a71-d56f7b155aff tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/1817f607-bf6e-42af-8287-c6ea8781f066" status: 200 len: 344 microversion: 2.1 time: 0.081653 Jun 24 09:48:48.354165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 417/815] 10.222.0.65 () {58 vars in 1244 bytes} [Fri Jun 24 09:48:48 2022] GET /compute/v2.1/os-volumes/1817f607-bf6e-42af-8287-c6ea8781f066 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:48:49.366725 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-95f34ed6-ce21-4eac-8a72-41c55034e154 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Calling method '.version_select at 0x7fc6d4a41e50>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:49.418539 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-95f34ed6-ce21-4eac-8a72-41c55034e154 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/1817f607-bf6e-42af-8287-c6ea8781f066" status: 200 len: 345 microversion: 2.1 time: 0.056414 Jun 24 09:48:49.419141 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 399/816] 10.222.0.65 () {58 vars in 1244 bytes} [Fri Jun 24 09:48:49 2022] GET /compute/v2.1/os-volumes/1817f607-bf6e-42af-8287-c6ea8781f066 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:48:49.431805 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-dad9394f-35d9-45f4-b156-0c1d00ae55c6 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Action: 'create', calling method: .version_select at 0x7fc6d42e5820>, body: {"snapshot": {"volume_id": "1817f607-bf6e-42af-8287-c6ea8781f066", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1990954871"}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:48:49.560570 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=19 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:49.641717 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-dad9394f-35d9-45f4-b156-0c1d00ae55c6 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] 10.222.0.65 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.214274 Jun 24 09:48:49.642482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 418/817] 10.222.0.65 () {60 vars in 1161 bytes} [Fri Jun 24 09:48:49 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:48:49.655181 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-83b3ce04-464c-408b-96f3-ce7bdf0dcce4 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Calling method '.version_select at 0x7fc6d4c0fb80>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:49.662442 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:49.663616 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:49.694310 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-83b3ce04-464c-408b-96f3-ce7bdf0dcce4 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/277d31ea-3320-41c0-bfa6-46b9f26761e2" status: 200 len: 287 microversion: 2.1 time: 0.045731 Jun 24 09:48:49.695452 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 400/818] 10.222.0.65 () {58 vars in 1250 bytes} [Fri Jun 24 09:48:49 2022] GET /compute/v2.1/os-snapshots/277d31ea-3320-41c0-bfa6-46b9f26761e2 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:48:49.705072 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f6f4e955-66fe-4ecc-b408-344f79ceb7fe tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Calling method '.version_select at 0x7fc6d4453ca0>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:49.738346 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f6f4e955-66fe-4ecc-b408-344f79ceb7fe tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.037015 Jun 24 09:48:49.739110 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 419/819] 10.222.0.65 () {58 vars in 1139 bytes} [Fri Jun 24 09:48:49 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:48:49.749361 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-5f3d12f3-0a5b-49c3-8c71-278c999026a9 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Calling method '.version_select at 0x7fc6d4ca5940>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:49.795331 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-5f3d12f3-0a5b-49c3-8c71-278c999026a9 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/277d31ea-3320-41c0-bfa6-46b9f26761e2" status: 200 len: 287 microversion: 2.1 time: 0.048351 Jun 24 09:48:49.796246 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 401/820] 10.222.0.65 () {58 vars in 1250 bytes} [Fri Jun 24 09:48:49 2022] GET /compute/v2.1/os-snapshots/277d31ea-3320-41c0-bfa6-46b9f26761e2 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:48:50.811600 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-63f6c842-f9e8-4d23-9a61-73edf3cc438a tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Calling method '.version_select at 0x7fc6d43f0ca0>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:50.861101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-63f6c842-f9e8-4d23-9a61-73edf3cc438a tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/277d31ea-3320-41c0-bfa6-46b9f26761e2" status: 200 len: 287 microversion: 2.1 time: 0.056945 Jun 24 09:48:50.861693 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 420/821] 10.222.0.65 () {58 vars in 1250 bytes} [Fri Jun 24 09:48:50 2022] GET /compute/v2.1/os-snapshots/277d31ea-3320-41c0-bfa6-46b9f26761e2 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:48:51.876747 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-21e8b0a6-52f3-42bf-a059-a391be903d3f tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Calling method '.version_select at 0x7fc6d4bf1af0>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:51.911501 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-21e8b0a6-52f3-42bf-a059-a391be903d3f tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/277d31ea-3320-41c0-bfa6-46b9f26761e2" status: 200 len: 287 microversion: 2.1 time: 0.040648 Jun 24 09:48:51.912255 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 402/822] 10.222.0.65 () {58 vars in 1250 bytes} [Fri Jun 24 09:48:51 2022] GET /compute/v2.1/os-snapshots/277d31ea-3320-41c0-bfa6-46b9f26761e2 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:48:52.924465 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7200600d-dafe-4e75-a278-fc4d8b363cfd tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Calling method '.version_select at 0x7fc6d442e1f0>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:52.955953 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-7200600d-dafe-4e75-a278-fc4d8b363cfd tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/277d31ea-3320-41c0-bfa6-46b9f26761e2" status: 200 len: 288 microversion: 2.1 time: 0.036578 Jun 24 09:48:52.956526 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 421/823] 10.222.0.65 () {58 vars in 1250 bytes} [Fri Jun 24 09:48:52 2022] GET /compute/v2.1/os-snapshots/277d31ea-3320-41c0-bfa6-46b9f26761e2 => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:48:52.968062 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-2447889d-03bb-4d47-b972-4efbd4b9cc5d tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Calling method '.version_select at 0x7fc6d4ca5940>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:53.036105 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-2447889d-03bb-4d47-b972-4efbd4b9cc5d tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] 10.222.0.65 "DELETE /compute/v2.1/os-snapshots/277d31ea-3320-41c0-bfa6-46b9f26761e2" status: 202 len: 0 microversion: 2.1 time: 0.072834 Jun 24 09:48:53.036687 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 403/824] 10.222.0.65 () {58 vars in 1253 bytes} [Fri Jun 24 09:48:52 2022] DELETE /compute/v2.1/os-snapshots/277d31ea-3320-41c0-bfa6-46b9f26761e2 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:48:53.045104 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-cab10cf1-5233-4e54-b85d-c2ceb860f493 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Calling method '.version_select at 0x7fc6d43f0c10>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:53.074176 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-cab10cf1-5233-4e54-b85d-c2ceb860f493 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/277d31ea-3320-41c0-bfa6-46b9f26761e2" status: 200 len: 287 microversion: 2.1 time: 0.032892 Jun 24 09:48:53.074744 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 422/825] 10.222.0.65 () {58 vars in 1250 bytes} [Fri Jun 24 09:48:53 2022] GET /compute/v2.1/os-snapshots/277d31ea-3320-41c0-bfa6-46b9f26761e2 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:48:54.086663 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-1ffd0e34-89fc-4b4f-a546-9d36a3b40272 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Calling method '.version_select at 0x7fc6d4a411f0>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:54.114489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.wsgi [None req-1ffd0e34-89fc-4b4f-a546-9d36a3b40272 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] HTTP exception thrown: Snapshot 277d31ea-3320-41c0-bfa6-46b9f26761e2 could not be found. Jun 24 09:48:54.118140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-1ffd0e34-89fc-4b4f-a546-9d36a3b40272 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Request method failure captured: Jun 24 09:48:54.118140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: GET /compute/v2.1/os-snapshots/277d31ea-3320-41c0-bfa6-46b9f26761e2 HTTP/1.1 Jun 24 09:48:54.118140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:48:54.118140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:48:54.118140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:48:54.118140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 0 Jun 24 09:48:54.118140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:48:54.118140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:48:54.118140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:48:54.118140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:48:54.118140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYh_wAtFh_ynfqzGiwEfBD4SkkNKvMkqCw6zZ3vsC6xhkv3YOvYctriOUNNJIo2ZZxGIc3ql0YXx-C-ygyBDLoe-LHb4l5k5yKfMGxwUdDMXhTA17kpe7TMejjSrjnAvLP0NegmA6EXDC1ECy9kpJN0PHJHZNumFYN2YzKktEOXpVQE Jun 24 09:48:54.118140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:48:54.118140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:48:54.118140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:48:54.118140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:48:54.118140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:48:54.118140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:48:54.118140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: 270cf0d110eb4e8fa107a4cf76b09691 Jun 24 09:48:54.118140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-112973119 Jun 24 09:48:54.118140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:48:54.118140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:48:54.119966 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_270cf0d110eb4e8fa107a4cf76b09691", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/270cf0d110eb4e8fa107a4cf76b09691"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/270cf0d110eb4e8fa107a4cf76b09691"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/270cf0d110eb4e8fa107a4cf76b09691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:48:54.119966 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-VolumesSnapshotsTestJSON-112973119 Jun 24 09:48:54.119966 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: 270cf0d110eb4e8fa107a4cf76b09691 Jun 24 09:48:54.119966 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-112973119 Jun 24 09:48:54.119966 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-VolumesSnapshotsTestJSON-112973119-project Jun 24 09:48:54.119966 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:48:54.119966 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:48:54.119966 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: 5a18b06cd76a4edebeb4085623969068 Jun 24 09:48:54.119966 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-VolumesSnapshotsTestJSON-112973119-project Jun 24 09:48:54.119966 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: Jun 24 09:48:54.119966 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Snapshot 277d31ea-3320-41c0-bfa6-46b9f26761e2 could not be found. Jun 24 09:48:54.119966 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'id': '277d31ea-3320-41c0-bfa6-46b9f26761e2'} Jun 24 09:48:54.119966 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:48:54.121086 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:54.121086 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 24 09:48:54.121086 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 24 09:48:54.121086 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 24 09:48:54.121086 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 24 09:48:54.121086 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 24 09:48:54.121086 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 24 09:48:54.121086 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 09:48:54.121086 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 09:48:54.121086 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 09:48:54.121086 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 09:48:54.121086 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:48:54.121086 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:48:54.121086 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:48:54.121086 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:48:54.121086 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 277d31ea-3320-41c0-bfa6-46b9f26761e2 could not be found. (HTTP 404) (Request-ID: req-9cbc54f2-64c3-44c7-b7b2-4481e5fa0fa6) Jun 24 09:48:54.121086 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:54.121086 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:54.122521 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:54.122521 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:54.122521 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 24 09:48:54.122521 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 24 09:48:54.122521 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:48:54.122521 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:48:54.122521 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 24 09:48:54.122521 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 24 09:48:54.122521 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:48:54.122521 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:48:54.122521 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 24 09:48:54.122521 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 24 09:48:54.122521 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 24 09:48:54.122521 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 24 09:48:54.122521 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 24 09:48:54.122521 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 24 09:48:54.122521 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 09:48:54.122521 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 09:48:54.122521 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 09:48:54.124110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 09:48:54.124110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:48:54.124110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:48:54.124110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:48:54.124110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:48:54.124110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 277d31ea-3320-41c0-bfa6-46b9f26761e2 could not be found. Jun 24 09:48:54.124110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:54.124110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:54.124110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:54.124110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:54.124110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:54.124110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:54.124110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:48:54.124110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:48:54.124110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 09:48:54.124110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 09:48:54.124110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:48:54.124110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:48:54.124110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 24 09:48:54.124110 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:48:54.125722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 277d31ea-3320-41c0-bfa6-46b9f26761e2 could not be found. Jun 24 09:48:54.125722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:54.125722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:54.125722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:54.125722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:54.125722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:54.125722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:54.125722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:48:54.125722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:48:54.125722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 277d31ea-3320-41c0-bfa6-46b9f26761e2 could not be found. Jun 24 09:48:54.125722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:54.125722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-1ffd0e34-89fc-4b4f-a546-9d36a3b40272 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Returning 404 to user: Snapshot 277d31ea-3320-41c0-bfa6-46b9f26761e2 could not be found. {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:48:54.125722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-1ffd0e34-89fc-4b4f-a546-9d36a3b40272 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/277d31ea-3320-41c0-bfa6-46b9f26761e2" status: 404 len: 111 microversion: 2.1 time: 0.037452 Jun 24 09:48:54.125722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 404/826] 10.222.0.65 () {58 vars in 1250 bytes} [Fri Jun 24 09:48:54 2022] GET /compute/v2.1/os-snapshots/277d31ea-3320-41c0-bfa6-46b9f26761e2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:48:54.129747 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3a5742a9-4cb7-4ff7-9c36-6cff704e4505 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Calling method '.version_select at 0x7fc6d42ab550>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:54.197402 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3a5742a9-4cb7-4ff7-9c36-6cff704e4505 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/1817f607-bf6e-42af-8287-c6ea8781f066" status: 202 len: 0 microversion: 2.1 time: 0.072061 Jun 24 09:48:54.197964 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 423/827] 10.222.0.65 () {58 vars in 1247 bytes} [Fri Jun 24 09:48:54 2022] DELETE /compute/v2.1/os-volumes/1817f607-bf6e-42af-8287-c6ea8781f066 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:48:54.206789 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-f83b55a0-6803-48c8-819b-45ac97882c0f tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Calling method '.version_select at 0x7fc6d4df0e50>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:54.258515 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-f83b55a0-6803-48c8-819b-45ac97882c0f tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/1817f607-bf6e-42af-8287-c6ea8781f066" status: 200 len: 344 microversion: 2.1 time: 0.055466 Jun 24 09:48:54.259096 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 405/828] 10.222.0.65 () {58 vars in 1244 bytes} [Fri Jun 24 09:48:54 2022] GET /compute/v2.1/os-volumes/1817f607-bf6e-42af-8287-c6ea8781f066 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:48:55.271993 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b1dba789-63f0-4311-adbf-54a14a0de003 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Calling method '.version_select at 0x7fc6d4453ca0>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:55.300955 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-b1dba789-63f0-4311-adbf-54a14a0de003 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] HTTP exception thrown: Volume 1817f607-bf6e-42af-8287-c6ea8781f066 could not be found. Jun 24 09:48:55.302929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b1dba789-63f0-4311-adbf-54a14a0de003 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Request method failure captured: Jun 24 09:48:55.302929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/os-volumes/1817f607-bf6e-42af-8287-c6ea8781f066 HTTP/1.1 Jun 24 09:48:55.302929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:48:55.302929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:48:55.302929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:48:55.302929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:48:55.302929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:48:55.302929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:48:55.302929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:48:55.302929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:48:55.302929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYh_wAtFh_ynfqzGiwEfBD4SkkNKvMkqCw6zZ3vsC6xhkv3YOvYctriOUNNJIo2ZZxGIc3ql0YXx-C-ygyBDLoe-LHb4l5k5yKfMGxwUdDMXhTA17kpe7TMejjSrjnAvLP0NegmA6EXDC1ECy9kpJN0PHJHZNumFYN2YzKktEOXpVQE Jun 24 09:48:55.302929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:48:55.302929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:48:55.302929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:48:55.302929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:48:55.302929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:48:55.302929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:48:55.302929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 270cf0d110eb4e8fa107a4cf76b09691 Jun 24 09:48:55.302929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-112973119 Jun 24 09:48:55.302929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:48:55.302929 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:48:55.304492 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_270cf0d110eb4e8fa107a4cf76b09691", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/270cf0d110eb4e8fa107a4cf76b09691"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/270cf0d110eb4e8fa107a4cf76b09691"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/270cf0d110eb4e8fa107a4cf76b09691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:48:55.304492 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-VolumesSnapshotsTestJSON-112973119 Jun 24 09:48:55.304492 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 270cf0d110eb4e8fa107a4cf76b09691 Jun 24 09:48:55.304492 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-112973119 Jun 24 09:48:55.304492 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-VolumesSnapshotsTestJSON-112973119-project Jun 24 09:48:55.304492 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:48:55.304492 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:48:55.304492 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: 5a18b06cd76a4edebeb4085623969068 Jun 24 09:48:55.304492 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-VolumesSnapshotsTestJSON-112973119-project Jun 24 09:48:55.304492 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: Jun 24 09:48:55.304492 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Volume 1817f607-bf6e-42af-8287-c6ea8781f066 could not be found. Jun 24 09:48:55.304492 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': '1817f607-bf6e-42af-8287-c6ea8781f066'} Jun 24 09:48:55.304492 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:48:55.305506 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:55.305506 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:48:55.305506 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:48:55.305506 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 09:48:55.305506 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 09:48:55.305506 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 09:48:55.305506 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 09:48:55.305506 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 09:48:55.305506 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 09:48:55.305506 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 09:48:55.305506 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 09:48:55.305506 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:48:55.305506 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:48:55.305506 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:48:55.305506 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:48:55.305506 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1817f607-bf6e-42af-8287-c6ea8781f066 could not be found. (HTTP 404) (Request-ID: req-7c1f3f14-af79-4f29-a12f-7bd7a31188d5) Jun 24 09:48:55.305506 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:55.305506 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:55.305506 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:55.306849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:55.306849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 09:48:55.306849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 09:48:55.306849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:48:55.306849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:48:55.306849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 09:48:55.306849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 09:48:55.306849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:48:55.306849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:48:55.306849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:48:55.306849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:48:55.306849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 09:48:55.306849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 09:48:55.306849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 09:48:55.306849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 09:48:55.306849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 09:48:55.306849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 09:48:55.306849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 09:48:55.306849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 09:48:55.308043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:48:55.308043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:48:55.308043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:48:55.308043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:48:55.308043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1817f607-bf6e-42af-8287-c6ea8781f066 could not be found. Jun 24 09:48:55.308043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:55.308043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:55.308043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:55.308043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:55.308043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:55.308043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:55.308043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:48:55.308043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:48:55.308043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 09:48:55.308043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 09:48:55.308043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:48:55.308043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:48:55.308043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 09:48:55.308043 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:48:55.309167 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1817f607-bf6e-42af-8287-c6ea8781f066 could not be found. Jun 24 09:48:55.309167 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:55.309167 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:55.309167 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:55.309167 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:55.309167 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:55.309167 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:55.309167 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:48:55.309167 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:48:55.309167 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1817f607-bf6e-42af-8287-c6ea8781f066 could not be found. Jun 24 09:48:55.309167 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:55.309167 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b1dba789-63f0-4311-adbf-54a14a0de003 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Returning 404 to user: Volume 1817f607-bf6e-42af-8287-c6ea8781f066 could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:48:55.309167 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b1dba789-63f0-4311-adbf-54a14a0de003 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/1817f607-bf6e-42af-8287-c6ea8781f066" status: 404 len: 109 microversion: 2.1 time: 0.036407 Jun 24 09:48:55.309167 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 424/829] 10.222.0.65 () {58 vars in 1244 bytes} [Fri Jun 24 09:48:55 2022] GET /compute/v2.1/os-volumes/1817f607-bf6e-42af-8287-c6ea8781f066 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:48:55.320012 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7daf1180-0ab9-4446-b0d2-1b01d08bc615 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Calling method '.version_select at 0x7fc6d4df0040>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:55.350391 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.wsgi [None req-7daf1180-0ab9-4446-b0d2-1b01d08bc615 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] HTTP exception thrown: Volume 1817f607-bf6e-42af-8287-c6ea8781f066 could not be found. Jun 24 09:48:55.352730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7daf1180-0ab9-4446-b0d2-1b01d08bc615 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Request method failure captured: Jun 24 09:48:55.352730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: DELETE /compute/v2.1/os-volumes/1817f607-bf6e-42af-8287-c6ea8781f066 HTTP/1.1 Jun 24 09:48:55.352730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:48:55.352730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:48:55.352730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:48:55.352730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 0 Jun 24 09:48:55.352730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:48:55.352730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:48:55.352730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:48:55.352730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:48:55.352730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYh_wAtFh_ynfqzGiwEfBD4SkkNKvMkqCw6zZ3vsC6xhkv3YOvYctriOUNNJIo2ZZxGIc3ql0YXx-C-ygyBDLoe-LHb4l5k5yKfMGxwUdDMXhTA17kpe7TMejjSrjnAvLP0NegmA6EXDC1ECy9kpJN0PHJHZNumFYN2YzKktEOXpVQE Jun 24 09:48:55.352730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:48:55.352730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:48:55.352730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:48:55.352730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:48:55.352730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:48:55.352730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:48:55.352730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: 270cf0d110eb4e8fa107a4cf76b09691 Jun 24 09:48:55.352730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-112973119 Jun 24 09:48:55.352730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:48:55.352730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:48:55.354311 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_270cf0d110eb4e8fa107a4cf76b09691", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/270cf0d110eb4e8fa107a4cf76b09691"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/270cf0d110eb4e8fa107a4cf76b09691"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/270cf0d110eb4e8fa107a4cf76b09691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:48:55.354311 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-VolumesSnapshotsTestJSON-112973119 Jun 24 09:48:55.354311 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: 270cf0d110eb4e8fa107a4cf76b09691 Jun 24 09:48:55.354311 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-112973119 Jun 24 09:48:55.354311 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-VolumesSnapshotsTestJSON-112973119-project Jun 24 09:48:55.354311 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:48:55.354311 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:48:55.354311 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: 5a18b06cd76a4edebeb4085623969068 Jun 24 09:48:55.354311 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-VolumesSnapshotsTestJSON-112973119-project Jun 24 09:48:55.354311 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: Jun 24 09:48:55.354311 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Volume 1817f607-bf6e-42af-8287-c6ea8781f066 could not be found. Jun 24 09:48:55.354311 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'id': '1817f607-bf6e-42af-8287-c6ea8781f066'} Jun 24 09:48:55.354311 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:48:55.355142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:55.355142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:48:55.355142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:48:55.355142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 09:48:55.355142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 09:48:55.355142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 09:48:55.355142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 09:48:55.355142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 09:48:55.355142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 09:48:55.355142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 09:48:55.355142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 09:48:55.355142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:48:55.355142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:48:55.355142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:48:55.355142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:48:55.355142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1817f607-bf6e-42af-8287-c6ea8781f066 could not be found. (HTTP 404) (Request-ID: req-7f6b8ace-334b-4059-93f8-0c2c193ebbfc) Jun 24 09:48:55.355142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:55.355142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:55.355142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:55.356399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:55.356399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 09:48:55.356399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 09:48:55.356399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:48:55.356399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:48:55.356399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 09:48:55.356399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 09:48:55.356399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:48:55.356399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:48:55.356399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:48:55.356399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:48:55.356399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 09:48:55.356399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 09:48:55.356399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 09:48:55.356399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 09:48:55.356399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 09:48:55.356399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 09:48:55.356399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 09:48:55.356399 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 09:48:55.357548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:48:55.357548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:48:55.357548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:48:55.357548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:48:55.357548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1817f607-bf6e-42af-8287-c6ea8781f066 could not be found. Jun 24 09:48:55.357548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:55.357548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:55.357548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:55.357548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:55.357548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:55.357548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:55.357548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:48:55.357548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:48:55.357548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 09:48:55.357548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 09:48:55.357548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:48:55.357548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:48:55.357548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 09:48:55.357548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:48:55.358732 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1817f607-bf6e-42af-8287-c6ea8781f066 could not be found. Jun 24 09:48:55.358732 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:55.358732 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:55.358732 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:55.358732 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:55.358732 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:55.358732 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:55.358732 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:48:55.358732 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:48:55.358732 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1817f607-bf6e-42af-8287-c6ea8781f066 could not be found. Jun 24 09:48:55.358732 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:48:55.358732 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7daf1180-0ab9-4446-b0d2-1b01d08bc615 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Returning 404 to user: Volume 1817f607-bf6e-42af-8287-c6ea8781f066 could not be found. {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:48:55.358732 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-7daf1180-0ab9-4446-b0d2-1b01d08bc615 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/1817f607-bf6e-42af-8287-c6ea8781f066" status: 404 len: 109 microversion: 2.1 time: 0.038590 Jun 24 09:48:55.358732 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 406/830] 10.222.0.65 () {58 vars in 1247 bytes} [Fri Jun 24 09:48:55 2022] DELETE /compute/v2.1/os-volumes/1817f607-bf6e-42af-8287-c6ea8781f066 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 09:48:55.365469 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4c08152d-7d51-43e8-adc9-79efe75300e5 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Calling method '.version_select at 0x7fc6d441c310>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:48:55.394895 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-4c08152d-7d51-43e8-adc9-79efe75300e5 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] HTTP exception thrown: Volume 1817f607-bf6e-42af-8287-c6ea8781f066 could not be found. Jun 24 09:48:55.396862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4c08152d-7d51-43e8-adc9-79efe75300e5 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Request method failure captured: Jun 24 09:48:55.396862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/os-volumes/1817f607-bf6e-42af-8287-c6ea8781f066 HTTP/1.1 Jun 24 09:48:55.396862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:48:55.396862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:48:55.396862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:48:55.396862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:48:55.396862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:48:55.396862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:48:55.396862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:48:55.396862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:48:55.396862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYh_wAtFh_ynfqzGiwEfBD4SkkNKvMkqCw6zZ3vsC6xhkv3YOvYctriOUNNJIo2ZZxGIc3ql0YXx-C-ygyBDLoe-LHb4l5k5yKfMGxwUdDMXhTA17kpe7TMejjSrjnAvLP0NegmA6EXDC1ECy9kpJN0PHJHZNumFYN2YzKktEOXpVQE Jun 24 09:48:55.396862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:48:55.396862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:48:55.396862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:48:55.396862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:48:55.396862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:48:55.396862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:48:55.396862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 270cf0d110eb4e8fa107a4cf76b09691 Jun 24 09:48:55.396862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-112973119 Jun 24 09:48:55.396862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:48:55.396862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:48:55.398294 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_270cf0d110eb4e8fa107a4cf76b09691", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/270cf0d110eb4e8fa107a4cf76b09691"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/270cf0d110eb4e8fa107a4cf76b09691"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/270cf0d110eb4e8fa107a4cf76b09691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:48:55.398294 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-VolumesSnapshotsTestJSON-112973119 Jun 24 09:48:55.398294 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 270cf0d110eb4e8fa107a4cf76b09691 Jun 24 09:48:55.398294 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-112973119 Jun 24 09:48:55.398294 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-VolumesSnapshotsTestJSON-112973119-project Jun 24 09:48:55.398294 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:48:55.398294 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:48:55.398294 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: 5a18b06cd76a4edebeb4085623969068 Jun 24 09:48:55.398294 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-VolumesSnapshotsTestJSON-112973119-project Jun 24 09:48:55.398294 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: Jun 24 09:48:55.398294 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Volume 1817f607-bf6e-42af-8287-c6ea8781f066 could not be found. Jun 24 09:48:55.398294 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': '1817f607-bf6e-42af-8287-c6ea8781f066'} Jun 24 09:48:55.398294 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:48:55.399165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:55.399165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:48:55.399165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:48:55.399165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 09:48:55.399165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 09:48:55.399165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 09:48:55.399165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 09:48:55.399165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 09:48:55.399165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 09:48:55.399165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 09:48:55.399165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 09:48:55.399165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:48:55.399165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:48:55.399165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:48:55.399165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:48:55.399165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1817f607-bf6e-42af-8287-c6ea8781f066 could not be found. (HTTP 404) (Request-ID: req-bf609c03-d12f-4c87-9e1d-ace99942aab4) Jun 24 09:48:55.399165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:55.399165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:55.399165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:55.400401 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:55.400401 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 09:48:55.400401 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 09:48:55.400401 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:48:55.400401 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:48:55.400401 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 09:48:55.400401 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 09:48:55.400401 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:48:55.400401 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:48:55.400401 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:48:55.400401 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:48:55.400401 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 09:48:55.400401 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 09:48:55.400401 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 09:48:55.400401 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 09:48:55.400401 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 09:48:55.400401 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 09:48:55.400401 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 09:48:55.400401 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 09:48:55.401912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:48:55.401912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:48:55.401912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:48:55.401912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:48:55.401912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1817f607-bf6e-42af-8287-c6ea8781f066 could not be found. Jun 24 09:48:55.401912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:55.401912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:55.401912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:55.401912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:55.401912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:55.401912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:55.401912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:48:55.401912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:48:55.401912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 09:48:55.401912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 09:48:55.401912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:48:55.401912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:48:55.401912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 09:48:55.401912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:48:55.403429 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1817f607-bf6e-42af-8287-c6ea8781f066 could not be found. Jun 24 09:48:55.403429 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:55.403429 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:48:55.403429 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:55.403429 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:48:55.403429 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:48:55.403429 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:48:55.403429 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:48:55.403429 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:48:55.403429 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1817f607-bf6e-42af-8287-c6ea8781f066 could not be found. Jun 24 09:48:55.403429 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:48:55.403429 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4c08152d-7d51-43e8-adc9-79efe75300e5 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] Returning 404 to user: Volume 1817f607-bf6e-42af-8287-c6ea8781f066 could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:48:55.403429 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-4c08152d-7d51-43e8-adc9-79efe75300e5 tempest-VolumesSnapshotsTestJSON-112973119 tempest-VolumesSnapshotsTestJSON-112973119-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/1817f607-bf6e-42af-8287-c6ea8781f066" status: 404 len: 109 microversion: 2.1 time: 0.036881 Jun 24 09:48:55.405011 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 425/831] 10.222.0.65 () {58 vars in 1244 bytes} [Fri Jun 24 09:48:55 2022] GET /compute/v2.1/os-volumes/1817f607-bf6e-42af-8287-c6ea8781f066 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:49:01.368593 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-325d7d41-aeca-492b-ba9c-e2dbd0228df0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:01.369744 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-325d7d41-aeca-492b-ba9c-e2dbd0228df0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:01.378910 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-325d7d41-aeca-492b-ba9c-e2dbd0228df0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:01.379469 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-325d7d41-aeca-492b-ba9c-e2dbd0228df0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:01.380378 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-325d7d41-aeca-492b-ba9c-e2dbd0228df0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:01.380919 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-325d7d41-aeca-492b-ba9c-e2dbd0228df0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:01.414803 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-325d7d41-aeca-492b-ba9c-e2dbd0228df0 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051203 Jun 24 09:49:01.415412 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 407/832] 10.222.0.65 () {60 vars in 1342 bytes} [Fri Jun 24 09:49:01 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:01.475792 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=4 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:01.476563 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:01.480810 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7ea16fb2-5802-4090-9640-b0b687e87008 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:01.481457 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-7ea16fb2-5802-4090-9640-b0b687e87008 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:01.488999 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7ea16fb2-5802-4090-9640-b0b687e87008 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:01.489456 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7ea16fb2-5802-4090-9640-b0b687e87008 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:01.490365 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7ea16fb2-5802-4090-9640-b0b687e87008 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:01.490808 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-7ea16fb2-5802-4090-9640-b0b687e87008 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:01.516151 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-7ea16fb2-5802-4090-9640-b0b687e87008 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Going to try to terminate instance {{(pid=124339) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:49:01.594848 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-7ea16fb2-5802-4090-9640-b0b687e87008 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 204 len: 0 microversion: 2.20 time: 0.120603 Jun 24 09:49:01.595480 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 426/833] 10.222.0.65 () {60 vars in 1279 bytes} [Fri Jun 24 09:49:01 2022] DELETE /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 09:49:01.603856 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-a86fb0ef-26e6-4545-84e3-02c01a63aaed tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:01.604488 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-a86fb0ef-26e6-4545-84e3-02c01a63aaed tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:01.613261 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a86fb0ef-26e6-4545-84e3-02c01a63aaed tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:01.613711 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a86fb0ef-26e6-4545-84e3-02c01a63aaed tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:01.614482 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a86fb0ef-26e6-4545-84e3-02c01a63aaed tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:01.614894 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a86fb0ef-26e6-4545-84e3-02c01a63aaed tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:01.757302 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-a86fb0ef-26e6-4545-84e3-02c01a63aaed tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:01.766613 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-a86fb0ef-26e6-4545-84e3-02c01a63aaed tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:01.768166 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-a86fb0ef-26e6-4545-84e3-02c01a63aaed tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:01.769346 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-a86fb0ef-26e6-4545-84e3-02c01a63aaed tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1724 microversion: 2.20 time: 0.169472 Jun 24 09:49:01.769893 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 408/834] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:49:01 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:49:02.789752 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e4413e1c-7b30-4b3c-ae2c-738578b1823f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:02.790496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e4413e1c-7b30-4b3c-ae2c-738578b1823f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:02.800421 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e4413e1c-7b30-4b3c-ae2c-738578b1823f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:02.800863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e4413e1c-7b30-4b3c-ae2c-738578b1823f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:02.801621 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e4413e1c-7b30-4b3c-ae2c-738578b1823f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:02.802045 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e4413e1c-7b30-4b3c-ae2c-738578b1823f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:02.939601 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e4413e1c-7b30-4b3c-ae2c-738578b1823f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:02.948758 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e4413e1c-7b30-4b3c-ae2c-738578b1823f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:02.949902 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e4413e1c-7b30-4b3c-ae2c-738578b1823f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:02.951106 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e4413e1c-7b30-4b3c-ae2c-738578b1823f tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1724 microversion: 2.20 time: 0.166612 Jun 24 09:49:02.951669 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 427/835] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:49:02 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:49:03.970650 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-1f22c7dd-6cc8-44c9-8621-217c31846004 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:03.971283 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-1f22c7dd-6cc8-44c9-8621-217c31846004 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:03.981243 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1f22c7dd-6cc8-44c9-8621-217c31846004 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:03.982002 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1f22c7dd-6cc8-44c9-8621-217c31846004 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:03.983364 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1f22c7dd-6cc8-44c9-8621-217c31846004 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:03.983809 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-1f22c7dd-6cc8-44c9-8621-217c31846004 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:04.137281 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-1f22c7dd-6cc8-44c9-8621-217c31846004 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:04.145884 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-1f22c7dd-6cc8-44c9-8621-217c31846004 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:04.147408 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-1f22c7dd-6cc8-44c9-8621-217c31846004 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:04.148584 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-1f22c7dd-6cc8-44c9-8621-217c31846004 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1724 microversion: 2.20 time: 0.182451 Jun 24 09:49:04.149143 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 409/836] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:49:03 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:49:05.167422 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1a043352-2117-41ee-9133-33440f9c6eac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:05.168107 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-1a043352-2117-41ee-9133-33440f9c6eac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:05.175327 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1a043352-2117-41ee-9133-33440f9c6eac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:05.175765 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1a043352-2117-41ee-9133-33440f9c6eac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:05.176556 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1a043352-2117-41ee-9133-33440f9c6eac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:05.176983 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1a043352-2117-41ee-9133-33440f9c6eac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:05.310528 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-1a043352-2117-41ee-9133-33440f9c6eac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:05.319729 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-1a043352-2117-41ee-9133-33440f9c6eac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:05.321159 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-1a043352-2117-41ee-9133-33440f9c6eac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:05.322346 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-1a043352-2117-41ee-9133-33440f9c6eac tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1724 microversion: 2.20 time: 0.159029 Jun 24 09:49:05.322957 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 428/837] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:49:05 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:49:06.321379 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-eaa2462c-1f40-4ec6-8f94-c81c6e335337 req-5c898003-b345-42b1-97d4-4f60fa2313c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661", "name": "network-vif-deleted", "tag": "6a505089-ab65-4375-b6e7-fc2f8ad2fb21"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:49:06.332736 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-eaa2462c-1f40-4ec6-8f94-c81c6e335337 req-5c898003-b345-42b1-97d4-4f60fa2313c4 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:06.333261 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-eaa2462c-1f40-4ec6-8f94-c81c6e335337 req-5c898003-b345-42b1-97d4-4f60fa2313c4 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:06.346890 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-eaa2462c-1f40-4ec6-8f94-c81c6e335337 req-5c898003-b345-42b1-97d4-4f60fa2313c4 service nova] Creating event network-vif-deleted:6a505089-ab65-4375-b6e7-fc2f8ad2fb21 for instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 on hv-cinder-80382 Jun 24 09:49:06.352599 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-eaa2462c-1f40-4ec6-8f94-c81c6e335337 req-5c898003-b345-42b1-97d4-4f60fa2313c4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036371 Jun 24 09:49:06.355893 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-929353a1-6da9-4809-bacc-8c368062619a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:06.358046 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 410/838] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:49:06.359601 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-929353a1-6da9-4809-bacc-8c368062619a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:06.369797 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-929353a1-6da9-4809-bacc-8c368062619a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:06.370406 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-929353a1-6da9-4809-bacc-8c368062619a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:06.372249 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-929353a1-6da9-4809-bacc-8c368062619a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:06.372913 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-929353a1-6da9-4809-bacc-8c368062619a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:06.464751 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-929353a1-6da9-4809-bacc-8c368062619a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:06.475686 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-929353a1-6da9-4809-bacc-8c368062619a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:06.477528 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-929353a1-6da9-4809-bacc-8c368062619a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '544cf118cc9e4aed8e7ec7e9dfe023bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64a8807499a44ababb8bb037fc3d195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:06.478863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-929353a1-6da9-4809-bacc-8c368062619a tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 200 len: 1366 microversion: 2.20 time: 0.142047 Jun 24 09:49:06.480492 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 429/839] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:49:06 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:49:06.929111 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-d951db68-7bef-46a4-8c1e-922750692966 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-265087753", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-853348123", "security_groups": [{"name": "tempest-secgroup-smoke-2012499460"}], "block_device_mapping_v2": [{"uuid": "7055e0ee-e0a5-49c4-9a2b-03ac06e4e199", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d67d849c-d27d-4bea-a085-4b945957c857"}]}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:49:07.046741 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.network.neutron [None req-d951db68-7bef-46a4-8c1e-922750692966 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] validate_networks() for [('d67d849c-d27d-4bea-a085-4b945957c857', None, None, None, None, None)] {{(pid=124338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:49:07.428625 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-d951db68-7bef-46a4-8c1e-922750692966 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Flavor limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:49:07.429220 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-d951db68-7bef-46a4-8c1e-922750692966 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Image limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:49:07.429596 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-d951db68-7bef-46a4-8c1e-922750692966 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Flavor pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:49:07.430010 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-d951db68-7bef-46a4-8c1e-922750692966 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Image pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:49:07.430424 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-d951db68-7bef-46a4-8c1e-922750692966 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:49:07.440338 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d951db68-7bef-46a4-8c1e-922750692966 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:07.440796 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d951db68-7bef-46a4-8c1e-922750692966 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:07.441609 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d951db68-7bef-46a4-8c1e-922750692966 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:07.442079 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d951db68-7bef-46a4-8c1e-922750692966 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:07.460075 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-d951db68-7bef-46a4-8c1e-922750692966 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Getting quotas for project 86f042cb88b7426ea9733f70033b55e3. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:49:07.464304 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-d951db68-7bef-46a4-8c1e-922750692966 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Getting quotas for user 565cc9705a94454b9e68595b85c6a286 and project 86f042cb88b7426ea9733f70033b55e3. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:49:07.497056 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-af4be185-0744-48b2-ba60-bc4cbf83762b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:07.497744 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-af4be185-0744-48b2-ba60-bc4cbf83762b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:07.504759 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-af4be185-0744-48b2-ba60-bc4cbf83762b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:07.505228 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-af4be185-0744-48b2-ba60-bc4cbf83762b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:07.506000 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-af4be185-0744-48b2-ba60-bc4cbf83762b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:07.506427 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-af4be185-0744-48b2-ba60-bc4cbf83762b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:07.520013 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-af4be185-0744-48b2-ba60-bc4cbf83762b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] HTTP exception thrown: Instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 could not be found. Jun 24 09:49:07.521834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-af4be185-0744-48b2-ba60-bc4cbf83762b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Request method failure captured: Jun 24 09:49:07.521834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 HTTP/1.1 Jun 24 09:49:07.521834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:49:07.521834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:49:07.521834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:49:07.521834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:49:07.521834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:49:07.521834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:49:07.521834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:49:07.521834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:49:07.521834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYburlfQdSFs4F278plB4ZGgx6ZT52NRZcMFsWY0-nTK27KnWWQK1uNzIXo_MqW9zGoQc8bds3Bf5D2rS2vof2x8JTdZB2dXuL8gw0Q0UcigCY7r2G1OhRyU2bx1HXWGh3Obw_4gDw4eO39MsyK0fKeP2_megi5gzBRaWWq2Nm58LD0 Jun 24 09:49:07.521834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:49:07.521834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:49:07.521834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:49:07.521834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:49:07.521834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 09:49:07.521834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:49:07.521834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:49:07.521834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: f64a8807499a44ababb8bb037fc3d195 Jun 24 09:49:07.521834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-66057315 Jun 24 09:49:07.521834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:49:07.521834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:49:07.523591 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f64a8807499a44ababb8bb037fc3d195", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f64a8807499a44ababb8bb037fc3d195"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f64a8807499a44ababb8bb037fc3d195"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f64a8807499a44ababb8bb037fc3d195"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:49:07.523591 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-AttachVolumeShelveTestJSON-66057315 Jun 24 09:49:07.523591 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: f64a8807499a44ababb8bb037fc3d195 Jun 24 09:49:07.523591 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-66057315 Jun 24 09:49:07.523591 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-AttachVolumeShelveTestJSON-66057315-project Jun 24 09:49:07.523591 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:49:07.523591 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:49:07.523591 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: 544cf118cc9e4aed8e7ec7e9dfe023bc Jun 24 09:49:07.523591 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-AttachVolumeShelveTestJSON-66057315-project Jun 24 09:49:07.523591 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:49:07.523591 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 could not be found. Jun 24 09:49:07.523591 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': '3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661'} Jun 24 09:49:07.524602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:49:07.524602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:49:07.524602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:49:07.524602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:49:07.524602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:49:07.524602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:49:07.524602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:49:07.524602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:49:07.524602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:49:07.524602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:49:07.524602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 could not be found. Jun 24 09:49:07.524602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:49:07.524602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:49:07.524602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:49:07.524602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:49:07.524602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:49:07.524602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:49:07.524602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:49:07.524602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:49:07.524602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:49:07.526063 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:49:07.526063 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:49:07.526063 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:49:07.526063 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:49:07.526063 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:49:07.526063 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:49:07.526063 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:49:07.526063 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 could not be found. Jun 24 09:49:07.526063 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:49:07.526063 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:49:07.526063 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:49:07.526063 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:49:07.526063 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:49:07.526063 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:49:07.526063 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:49:07.526063 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:49:07.526063 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 could not be found. Jun 24 09:49:07.526063 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:49:07.527466 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-af4be185-0744-48b2-ba60-bc4cbf83762b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Returning 404 to user: Instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:49:07.527568 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-d951db68-7bef-46a4-8c1e-922750692966 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Going to run 1 instances... {{(pid=124338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:49:07.527673 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-af4be185-0744-48b2-ba60-bc4cbf83762b tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 404 len: 111 microversion: 2.20 time: 0.030182 Jun 24 09:49:07.527673 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 430/840] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:49:07 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 09:49:07.527856 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-d951db68-7bef-46a4-8c1e-922750692966 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7055e0ee-e0a5-49c4-9a2b-03ac06e4e199',volume_size=None,volume_type=None)] {{(pid=124338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:49:07.532473 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-39afe7fd-2dae-4917-b51c-4a03b915630e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '.version_select at 0x7fc6d42e5820>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:07.552202 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-39afe7fd-2dae-4917-b51c-4a03b915630e tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2016977405" status: 204 len: 0 microversion: 2.20 time: 0.023699 Jun 24 09:49:07.552994 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 431/841] 10.222.0.65 () {60 vars in 1261 bytes} [Fri Jun 24 09:49:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2016977405 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 09:49:07.665934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-d951db68-7bef-46a4-8c1e-922750692966 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.741028 Jun 24 09:49:07.666917 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 411/842] 10.222.0.65 () {60 vars in 1146 bytes} [Fri Jun 24 09:49:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 09:49:07.677134 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e09c7f2f-48ac-453a-9b1e-8e5d3883110b tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:07.678190 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e09c7f2f-48ac-453a-9b1e-8e5d3883110b tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:07.802266 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e09c7f2f-48ac-453a-9b1e-8e5d3883110b tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:07.810090 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e09c7f2f-48ac-453a-9b1e-8e5d3883110b tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 200 len: 1093 microversion: 2.1 time: 0.136555 Jun 24 09:49:07.811113 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 432/843] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:07 2022] GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 1093 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:08.828520 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-045d3df4-e219-4a49-a589-6ed9545bf697 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:08.829760 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-045d3df4-e219-4a49-a589-6ed9545bf697 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:08.837418 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-045d3df4-e219-4a49-a589-6ed9545bf697 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:08.838593 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-045d3df4-e219-4a49-a589-6ed9545bf697 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:08.839586 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-045d3df4-e219-4a49-a589-6ed9545bf697 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:08.840283 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-045d3df4-e219-4a49-a589-6ed9545bf697 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:08.937031 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-045d3df4-e219-4a49-a589-6ed9545bf697 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:08.950132 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-045d3df4-e219-4a49-a589-6ed9545bf697 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 200 len: 1209 microversion: 2.1 time: 0.126425 Jun 24 09:49:08.950837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 412/844] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:08 2022] GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 1209 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:09.413915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1b1f4d5d-ee9f-433c-8aaa-be771855e7e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:09.414479 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-1b1f4d5d-ee9f-433c-8aaa-be771855e7e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:09.423297 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1b1f4d5d-ee9f-433c-8aaa-be771855e7e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:09.423748 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1b1f4d5d-ee9f-433c-8aaa-be771855e7e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:09.424543 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1b1f4d5d-ee9f-433c-8aaa-be771855e7e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:09.424974 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1b1f4d5d-ee9f-433c-8aaa-be771855e7e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:09.443366 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-1b1f4d5d-ee9f-433c-8aaa-be771855e7e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] HTTP exception thrown: Instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 could not be found. Jun 24 09:49:09.445387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1b1f4d5d-ee9f-433c-8aaa-be771855e7e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Request method failure captured: Jun 24 09:49:09.445387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: DELETE /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 HTTP/1.1 Jun 24 09:49:09.445387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:49:09.445387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:49:09.445387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:49:09.445387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:49:09.445387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:49:09.445387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:49:09.445387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:49:09.445387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:49:09.445387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYburlfQdSFs4F278plB4ZGgx6ZT52NRZcMFsWY0-nTK27KnWWQK1uNzIXo_MqW9zGoQc8bds3Bf5D2rS2vof2x8JTdZB2dXuL8gw0Q0UcigCY7r2G1OhRyU2bx1HXWGh3Obw_4gDw4eO39MsyK0fKeP2_megi5gzBRaWWq2Nm58LD0 Jun 24 09:49:09.445387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:49:09.445387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:49:09.445387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:49:09.445387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:49:09.445387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 09:49:09.445387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:49:09.445387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:49:09.445387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: f64a8807499a44ababb8bb037fc3d195 Jun 24 09:49:09.445387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-66057315 Jun 24 09:49:09.445387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:49:09.445387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:49:09.447029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f64a8807499a44ababb8bb037fc3d195", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f64a8807499a44ababb8bb037fc3d195"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f64a8807499a44ababb8bb037fc3d195"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f64a8807499a44ababb8bb037fc3d195"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:49:09.447029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-AttachVolumeShelveTestJSON-66057315 Jun 24 09:49:09.447029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: f64a8807499a44ababb8bb037fc3d195 Jun 24 09:49:09.447029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-66057315 Jun 24 09:49:09.447029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-AttachVolumeShelveTestJSON-66057315-project Jun 24 09:49:09.447029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:49:09.447029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:49:09.447029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: 544cf118cc9e4aed8e7ec7e9dfe023bc Jun 24 09:49:09.447029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-AttachVolumeShelveTestJSON-66057315-project Jun 24 09:49:09.447029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:49:09.447029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 could not be found. Jun 24 09:49:09.447029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': '3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661'} Jun 24 09:49:09.447892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:49:09.447892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:49:09.447892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:49:09.447892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:49:09.447892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:49:09.447892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:49:09.447892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:49:09.447892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:49:09.447892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:49:09.447892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:49:09.447892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 could not be found. Jun 24 09:49:09.447892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:49:09.447892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:49:09.447892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:49:09.447892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:49:09.447892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:49:09.447892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:49:09.447892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:49:09.447892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:49:09.447892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:49:09.449364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:49:09.449364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 09:49:09.449364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 09:49:09.449364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 09:49:09.449364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 09:49:09.449364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:49:09.449364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:49:09.449364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:49:09.449364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:49:09.449364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 could not be found. Jun 24 09:49:09.449364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:49:09.449364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:49:09.449364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:49:09.449364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:49:09.449364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:49:09.449364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:49:09.449364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:49:09.449364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:49:09.449364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 could not be found. Jun 24 09:49:09.449364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:49:09.450799 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1b1f4d5d-ee9f-433c-8aaa-be771855e7e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Returning 404 to user: Instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:49:09.455584 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-1b1f4d5d-ee9f-433c-8aaa-be771855e7e9 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 404 len: 111 microversion: 2.20 time: 0.042195 Jun 24 09:49:09.456484 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 433/845] 10.222.0.65 () {60 vars in 1279 bytes} [Fri Jun 24 09:49:09 2022] DELETE /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 09:49:09.465386 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-36dc1954-29eb-449d-9893-acf99a4afd57 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:09.466216 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-36dc1954-29eb-449d-9893-acf99a4afd57 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:09.473377 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-36dc1954-29eb-449d-9893-acf99a4afd57 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:09.473830 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-36dc1954-29eb-449d-9893-acf99a4afd57 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:09.474618 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-36dc1954-29eb-449d-9893-acf99a4afd57 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:09.475041 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-36dc1954-29eb-449d-9893-acf99a4afd57 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:09.491681 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.wsgi [None req-36dc1954-29eb-449d-9893-acf99a4afd57 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] HTTP exception thrown: Instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 could not be found. Jun 24 09:49:09.493637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-36dc1954-29eb-449d-9893-acf99a4afd57 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Request method failure captured: Jun 24 09:49:09.493637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 HTTP/1.1 Jun 24 09:49:09.493637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:49:09.493637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:49:09.493637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:49:09.493637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 0 Jun 24 09:49:09.493637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:49:09.493637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:49:09.493637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:49:09.493637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:49:09.493637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYburlfQdSFs4F278plB4ZGgx6ZT52NRZcMFsWY0-nTK27KnWWQK1uNzIXo_MqW9zGoQc8bds3Bf5D2rS2vof2x8JTdZB2dXuL8gw0Q0UcigCY7r2G1OhRyU2bx1HXWGh3Obw_4gDw4eO39MsyK0fKeP2_megi5gzBRaWWq2Nm58LD0 Jun 24 09:49:09.493637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:49:09.493637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:49:09.493637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:49:09.493637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:49:09.493637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 09:49:09.493637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:49:09.493637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:49:09.493637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: f64a8807499a44ababb8bb037fc3d195 Jun 24 09:49:09.493637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-66057315 Jun 24 09:49:09.493637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:49:09.493637 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:49:09.495360 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f64a8807499a44ababb8bb037fc3d195", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f64a8807499a44ababb8bb037fc3d195"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f64a8807499a44ababb8bb037fc3d195"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f64a8807499a44ababb8bb037fc3d195"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:49:09.495360 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-AttachVolumeShelveTestJSON-66057315 Jun 24 09:49:09.495360 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: f64a8807499a44ababb8bb037fc3d195 Jun 24 09:49:09.495360 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-66057315 Jun 24 09:49:09.495360 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-AttachVolumeShelveTestJSON-66057315-project Jun 24 09:49:09.495360 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:49:09.495360 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:49:09.495360 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: 544cf118cc9e4aed8e7ec7e9dfe023bc Jun 24 09:49:09.495360 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-AttachVolumeShelveTestJSON-66057315-project Jun 24 09:49:09.495360 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: > Jun 24 09:49:09.495360 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 could not be found. Jun 24 09:49:09.495360 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'id': '3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661'} Jun 24 09:49:09.499423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:49:09.499423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:49:09.499423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:49:09.499423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:49:09.499423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:49:09.499423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:49:09.499423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:49:09.499423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:49:09.499423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:49:09.499423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:49:09.499423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 could not be found. Jun 24 09:49:09.499423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:49:09.499423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:49:09.499423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:49:09.499423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:49:09.499423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:49:09.499423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:49:09.499423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:49:09.499423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:49:09.499423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:49:09.500828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:49:09.500828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:49:09.500828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:49:09.500828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:49:09.500828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:49:09.500828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:49:09.500828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:49:09.500828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 could not be found. Jun 24 09:49:09.500828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:49:09.500828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:49:09.500828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:49:09.500828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:49:09.500828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:49:09.500828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:49:09.500828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:49:09.500828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:49:09.500828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 could not be found. Jun 24 09:49:09.500828 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:49:09.502100 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-36dc1954-29eb-449d-9893-acf99a4afd57 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Returning 404 to user: Instance 3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 could not be found. {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:49:09.502100 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-36dc1954-29eb-449d-9893-acf99a4afd57 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661" status: 404 len: 111 microversion: 2.20 time: 0.034964 Jun 24 09:49:09.502100 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 413/846] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:49:09 2022] GET /compute/v2.1/servers/3f1c9e3d-1c9d-4e08-bf21-18d9f72dc661 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 09:49:09.969364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1a7fb13c-fe68-41ba-a015-4e5b532fad07 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:09.970249 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-1a7fb13c-fe68-41ba-a015-4e5b532fad07 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:09.978627 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1a7fb13c-fe68-41ba-a015-4e5b532fad07 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:09.979396 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1a7fb13c-fe68-41ba-a015-4e5b532fad07 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:09.980180 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1a7fb13c-fe68-41ba-a015-4e5b532fad07 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:09.980610 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1a7fb13c-fe68-41ba-a015-4e5b532fad07 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:10.224788 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-1a7fb13c-fe68-41ba-a015-4e5b532fad07 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:10.233669 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-1a7fb13c-fe68-41ba-a015-4e5b532fad07 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 200 len: 1265 microversion: 2.1 time: 0.268739 Jun 24 09:49:10.234359 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 434/847] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:09 2022] GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 1265 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:10.347249 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-9e22bba7-f7bf-4108-84d5-399e478d25b6 req-efe6d226-2763-4613-b611-7b787f72cd78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e6afd14-78c2-4765-b7ed-dfd75579caad", "tag": "c5dfd2a6-c3d5-4903-bff2-2f159ad63caf"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:49:10.364336 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-9e22bba7-f7bf-4108-84d5-399e478d25b6 req-efe6d226-2763-4613-b611-7b787f72cd78 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:10.365007 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-9e22bba7-f7bf-4108-84d5-399e478d25b6 req-efe6d226-2763-4613-b611-7b787f72cd78 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:10.383761 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-9e22bba7-f7bf-4108-84d5-399e478d25b6 req-efe6d226-2763-4613-b611-7b787f72cd78 service nova] Creating event network-changed:c5dfd2a6-c3d5-4903-bff2-2f159ad63caf for instance 4e6afd14-78c2-4765-b7ed-dfd75579caad on hv-cinder-80382 Jun 24 09:49:10.396969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-9e22bba7-f7bf-4108-84d5-399e478d25b6 req-efe6d226-2763-4613-b611-7b787f72cd78 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053735 Jun 24 09:49:10.398421 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 414/848] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:49:10.680153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-0a2d08b9-f96e-49e3-874a-950ec81434a3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:10.681576 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-0a2d08b9-f96e-49e3-874a-950ec81434a3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:10.688212 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0a2d08b9-f96e-49e3-874a-950ec81434a3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:10.688663 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0a2d08b9-f96e-49e3-874a-950ec81434a3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:10.689448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0a2d08b9-f96e-49e3-874a-950ec81434a3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:10.689886 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0a2d08b9-f96e-49e3-874a-950ec81434a3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:10.704447 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-0a2d08b9-f96e-49e3-874a-950ec81434a3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] HTTP exception thrown: Instance aa551ac0-154e-4145-acc0-725155004e69 could not be found. Jun 24 09:49:10.706039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-0a2d08b9-f96e-49e3-874a-950ec81434a3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Request method failure captured: Jun 24 09:49:10.706039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: DELETE /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 HTTP/1.1 Jun 24 09:49:10.706039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:49:10.706039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:49:10.706039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:49:10.706039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:49:10.706039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:49:10.706039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:49:10.706039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:49:10.706039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:49:10.706039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYburlfQdSFs4F278plB4ZGgx6ZT52NRZcMFsWY0-nTK27KnWWQK1uNzIXo_MqW9zGoQc8bds3Bf5D2rS2vof2x8JTdZB2dXuL8gw0Q0UcigCY7r2G1OhRyU2bx1HXWGh3Obw_4gDw4eO39MsyK0fKeP2_megi5gzBRaWWq2Nm58LD0 Jun 24 09:49:10.706039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:49:10.706039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:49:10.706039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:49:10.706039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:49:10.706039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 09:49:10.706039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:49:10.706039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:49:10.706039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: f64a8807499a44ababb8bb037fc3d195 Jun 24 09:49:10.706039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-66057315 Jun 24 09:49:10.706039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:49:10.706039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:49:10.707486 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f64a8807499a44ababb8bb037fc3d195", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f64a8807499a44ababb8bb037fc3d195"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f64a8807499a44ababb8bb037fc3d195"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f64a8807499a44ababb8bb037fc3d195"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:49:10.707486 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-AttachVolumeShelveTestJSON-66057315 Jun 24 09:49:10.707486 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: f64a8807499a44ababb8bb037fc3d195 Jun 24 09:49:10.707486 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-66057315 Jun 24 09:49:10.707486 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-AttachVolumeShelveTestJSON-66057315-project Jun 24 09:49:10.707486 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:49:10.707486 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:49:10.707486 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: 544cf118cc9e4aed8e7ec7e9dfe023bc Jun 24 09:49:10.707486 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-AttachVolumeShelveTestJSON-66057315-project Jun 24 09:49:10.707486 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:49:10.707486 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance aa551ac0-154e-4145-acc0-725155004e69 could not be found. Jun 24 09:49:10.707486 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': 'aa551ac0-154e-4145-acc0-725155004e69'} Jun 24 09:49:10.708227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:49:10.708227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:49:10.708227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:49:10.708227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:49:10.708227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:49:10.708227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:49:10.708227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:49:10.708227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:49:10.708227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:49:10.708227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:49:10.708227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa551ac0-154e-4145-acc0-725155004e69 could not be found. Jun 24 09:49:10.708227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:49:10.708227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:49:10.708227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:49:10.708227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:49:10.708227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:49:10.708227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:49:10.708227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:49:10.708227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:49:10.708227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:49:10.709857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:49:10.709857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 09:49:10.709857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 09:49:10.709857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 09:49:10.709857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 09:49:10.709857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:49:10.709857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:49:10.709857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:49:10.709857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:49:10.709857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa551ac0-154e-4145-acc0-725155004e69 could not be found. Jun 24 09:49:10.709857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:49:10.709857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:49:10.709857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:49:10.709857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:49:10.709857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:49:10.709857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:49:10.709857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:49:10.709857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:49:10.709857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa551ac0-154e-4145-acc0-725155004e69 could not be found. Jun 24 09:49:10.709857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:49:10.711054 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-0a2d08b9-f96e-49e3-874a-950ec81434a3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Returning 404 to user: Instance aa551ac0-154e-4145-acc0-725155004e69 could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:49:10.711054 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-0a2d08b9-f96e-49e3-874a-950ec81434a3 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "DELETE /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 404 len: 111 microversion: 2.20 time: 0.031685 Jun 24 09:49:10.711054 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 435/849] 10.222.0.65 () {60 vars in 1279 bytes} [Fri Jun 24 09:49:10 2022] DELETE /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 09:49:10.717665 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-c0ff0c30-d749-4bbf-8087-6b2d16be3956 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:10.718382 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-c0ff0c30-d749-4bbf-8087-6b2d16be3956 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] [instance: aa551ac0-154e-4145-acc0-725155004e69] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:10.725202 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c0ff0c30-d749-4bbf-8087-6b2d16be3956 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:10.725972 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c0ff0c30-d749-4bbf-8087-6b2d16be3956 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:10.726938 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c0ff0c30-d749-4bbf-8087-6b2d16be3956 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:10.727740 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c0ff0c30-d749-4bbf-8087-6b2d16be3956 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:10.744204 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.wsgi [None req-c0ff0c30-d749-4bbf-8087-6b2d16be3956 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] HTTP exception thrown: Instance aa551ac0-154e-4145-acc0-725155004e69 could not be found. Jun 24 09:49:10.745899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-c0ff0c30-d749-4bbf-8087-6b2d16be3956 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Request method failure captured: Jun 24 09:49:10.745899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 HTTP/1.1 Jun 24 09:49:10.745899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:49:10.745899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:49:10.745899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:49:10.745899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 0 Jun 24 09:49:10.745899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:49:10.745899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:49:10.745899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:49:10.745899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:49:10.745899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYburlfQdSFs4F278plB4ZGgx6ZT52NRZcMFsWY0-nTK27KnWWQK1uNzIXo_MqW9zGoQc8bds3Bf5D2rS2vof2x8JTdZB2dXuL8gw0Q0UcigCY7r2G1OhRyU2bx1HXWGh3Obw_4gDw4eO39MsyK0fKeP2_megi5gzBRaWWq2Nm58LD0 Jun 24 09:49:10.745899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:49:10.745899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:49:10.745899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:49:10.745899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:49:10.745899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 09:49:10.745899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:49:10.745899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:49:10.745899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: f64a8807499a44ababb8bb037fc3d195 Jun 24 09:49:10.745899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-66057315 Jun 24 09:49:10.745899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:49:10.745899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:49:10.747313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f64a8807499a44ababb8bb037fc3d195", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f64a8807499a44ababb8bb037fc3d195"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f64a8807499a44ababb8bb037fc3d195"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f64a8807499a44ababb8bb037fc3d195"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:49:10.747313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-AttachVolumeShelveTestJSON-66057315 Jun 24 09:49:10.747313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: f64a8807499a44ababb8bb037fc3d195 Jun 24 09:49:10.747313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-66057315 Jun 24 09:49:10.747313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-AttachVolumeShelveTestJSON-66057315-project Jun 24 09:49:10.747313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:49:10.747313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:49:10.747313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: 544cf118cc9e4aed8e7ec7e9dfe023bc Jun 24 09:49:10.747313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-AttachVolumeShelveTestJSON-66057315-project Jun 24 09:49:10.747313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: > Jun 24 09:49:10.747313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Instance aa551ac0-154e-4145-acc0-725155004e69 could not be found. Jun 24 09:49:10.747313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'id': 'aa551ac0-154e-4145-acc0-725155004e69'} Jun 24 09:49:10.748055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:49:10.748055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:49:10.748055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:49:10.748055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:49:10.748055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:49:10.748055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:49:10.748055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:49:10.748055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:49:10.748055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:49:10.748055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:49:10.748055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa551ac0-154e-4145-acc0-725155004e69 could not be found. Jun 24 09:49:10.748055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:49:10.748055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:49:10.748055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:49:10.748055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:49:10.748055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:49:10.748055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:49:10.748055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:49:10.748055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:49:10.748055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:49:10.749698 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:49:10.749698 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:49:10.749698 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:49:10.749698 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:49:10.749698 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:49:10.749698 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:49:10.749698 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:49:10.749698 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa551ac0-154e-4145-acc0-725155004e69 could not be found. Jun 24 09:49:10.749698 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:49:10.749698 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:49:10.749698 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:49:10.749698 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:49:10.749698 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:49:10.749698 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:49:10.749698 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:49:10.749698 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:49:10.749698 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa551ac0-154e-4145-acc0-725155004e69 could not be found. Jun 24 09:49:10.749698 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:49:10.750803 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-c0ff0c30-d749-4bbf-8087-6b2d16be3956 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] Returning 404 to user: Instance aa551ac0-154e-4145-acc0-725155004e69 could not be found. {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:49:10.750803 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-c0ff0c30-d749-4bbf-8087-6b2d16be3956 tempest-AttachVolumeShelveTestJSON-66057315 tempest-AttachVolumeShelveTestJSON-66057315-project] 10.222.0.65 "GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69" status: 404 len: 111 microversion: 2.20 time: 0.034648 Jun 24 09:49:10.750803 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 415/850] 10.222.0.65 () {60 vars in 1276 bytes} [Fri Jun 24 09:49:10 2022] GET /compute/v2.1/servers/aa551ac0-154e-4145-acc0-725155004e69 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 09:49:11.251215 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-009069bb-79e4-45c4-8b77-f7271a861503 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:11.251823 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-009069bb-79e4-45c4-8b77-f7271a861503 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:11.260728 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-009069bb-79e4-45c4-8b77-f7271a861503 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:11.261849 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-009069bb-79e4-45c4-8b77-f7271a861503 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:11.263306 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-009069bb-79e4-45c4-8b77-f7271a861503 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:11.266375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-009069bb-79e4-45c4-8b77-f7271a861503 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:11.671459 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-009069bb-79e4-45c4-8b77-f7271a861503 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:11.681456 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-009069bb-79e4-45c4-8b77-f7271a861503 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 200 len: 1265 microversion: 2.1 time: 0.434132 Jun 24 09:49:11.682112 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 436/851] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:11 2022] GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 1265 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:12.697622 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-c1728a4b-7c89-4b32-96d3-a68e3c521ffa tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:12.699172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-c1728a4b-7c89-4b32-96d3-a68e3c521ffa tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:12.706965 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c1728a4b-7c89-4b32-96d3-a68e3c521ffa tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:12.707457 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c1728a4b-7c89-4b32-96d3-a68e3c521ffa tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:12.708298 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c1728a4b-7c89-4b32-96d3-a68e3c521ffa tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:12.708675 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c1728a4b-7c89-4b32-96d3-a68e3c521ffa tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:12.874774 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-c1728a4b-7c89-4b32-96d3-a68e3c521ffa tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:12.883589 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-c1728a4b-7c89-4b32-96d3-a68e3c521ffa tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 200 len: 1265 microversion: 2.1 time: 0.189779 Jun 24 09:49:12.884433 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 416/852] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:12 2022] GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:13.901206 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-fe94bf20-21a7-4f67-bef5-59a28d8f495f tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:13.902371 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-fe94bf20-21a7-4f67-bef5-59a28d8f495f tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:13.909823 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fe94bf20-21a7-4f67-bef5-59a28d8f495f tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:13.910528 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fe94bf20-21a7-4f67-bef5-59a28d8f495f tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:13.911497 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fe94bf20-21a7-4f67-bef5-59a28d8f495f tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:13.912069 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-fe94bf20-21a7-4f67-bef5-59a28d8f495f tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:14.119016 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-fe94bf20-21a7-4f67-bef5-59a28d8f495f tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:14.128676 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-fe94bf20-21a7-4f67-bef5-59a28d8f495f tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 200 len: 1265 microversion: 2.1 time: 0.231929 Jun 24 09:49:14.129582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 437/853] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:13 2022] GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:15.145579 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-38a12299-083f-4c43-8e35-fce190c5604d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:15.146783 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-38a12299-083f-4c43-8e35-fce190c5604d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:15.153172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-38a12299-083f-4c43-8e35-fce190c5604d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:15.153627 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-38a12299-083f-4c43-8e35-fce190c5604d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:15.154851 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-38a12299-083f-4c43-8e35-fce190c5604d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:15.155419 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-38a12299-083f-4c43-8e35-fce190c5604d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:15.314490 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-38a12299-083f-4c43-8e35-fce190c5604d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:15.326829 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-38a12299-083f-4c43-8e35-fce190c5604d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 200 len: 1265 microversion: 2.1 time: 0.185108 Jun 24 09:49:15.327848 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 417/854] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:15 2022] GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:16.344868 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-eadd2747-d83a-4053-9a10-90d74bca2eb5 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:16.345446 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-eadd2747-d83a-4053-9a10-90d74bca2eb5 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:16.355209 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eadd2747-d83a-4053-9a10-90d74bca2eb5 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:16.355861 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eadd2747-d83a-4053-9a10-90d74bca2eb5 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:16.356622 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eadd2747-d83a-4053-9a10-90d74bca2eb5 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:16.357255 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eadd2747-d83a-4053-9a10-90d74bca2eb5 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:16.519023 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-eadd2747-d83a-4053-9a10-90d74bca2eb5 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:16.527288 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-eadd2747-d83a-4053-9a10-90d74bca2eb5 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 200 len: 1265 microversion: 2.1 time: 0.186798 Jun 24 09:49:16.527946 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 438/855] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:16 2022] GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:17.545297 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-87a7745c-157b-449d-8d65-5150b11c64e6 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:17.545859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-87a7745c-157b-449d-8d65-5150b11c64e6 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:17.548479 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=2 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:17.549615 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=6 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:17.554767 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-87a7745c-157b-449d-8d65-5150b11c64e6 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:17.555729 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-87a7745c-157b-449d-8d65-5150b11c64e6 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:17.556987 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-87a7745c-157b-449d-8d65-5150b11c64e6 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:17.557518 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-87a7745c-157b-449d-8d65-5150b11c64e6 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:17.738713 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-87a7745c-157b-449d-8d65-5150b11c64e6 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:17.766625 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-87a7745c-157b-449d-8d65-5150b11c64e6 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 200 len: 1265 microversion: 2.1 time: 0.225548 Jun 24 09:49:17.770747 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 418/856] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:17 2022] GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:18.787704 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b113f49f-cfcb-4ecc-8d05-8fe61941003c tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:18.789595 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-b113f49f-cfcb-4ecc-8d05-8fe61941003c tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:18.794156 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=2 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:18.803500 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b113f49f-cfcb-4ecc-8d05-8fe61941003c tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:18.804232 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b113f49f-cfcb-4ecc-8d05-8fe61941003c tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:18.805193 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b113f49f-cfcb-4ecc-8d05-8fe61941003c tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:18.805778 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b113f49f-cfcb-4ecc-8d05-8fe61941003c tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:19.043739 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b113f49f-cfcb-4ecc-8d05-8fe61941003c tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:19.051013 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b113f49f-cfcb-4ecc-8d05-8fe61941003c tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 200 len: 1265 microversion: 2.1 time: 0.267751 Jun 24 09:49:19.051913 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 439/857] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:18 2022] GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:20.068178 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-3fb1b7e9-826a-4517-8a07-6281b716909c tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:20.069533 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-3fb1b7e9-826a-4517-8a07-6281b716909c tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:20.084330 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3fb1b7e9-826a-4517-8a07-6281b716909c tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:20.085136 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3fb1b7e9-826a-4517-8a07-6281b716909c tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:20.086144 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3fb1b7e9-826a-4517-8a07-6281b716909c tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:20.086833 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3fb1b7e9-826a-4517-8a07-6281b716909c tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:20.309143 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-3fb1b7e9-826a-4517-8a07-6281b716909c tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:20.318925 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-3fb1b7e9-826a-4517-8a07-6281b716909c tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 200 len: 1265 microversion: 2.1 time: 0.254422 Jun 24 09:49:20.319564 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 419/858] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:20 2022] GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:49:20.767933 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-58e2b1f4-f306-4bd8-997a-abf6adc7f8dc tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Action: 'create', calling method: .version_select at 0x7fc6d428a790>, body: {"keypair": {"name": "tempest-keypair-1341101253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCESgOyYoo0aAn4C7Cd5VTrAlYX4FQVqMHhHLlUtTRFa3rYlsEy8coRh7b6sWfwj2jp5nTuiD2gnWkL6GpDzK1kRPC9OAYe+2Q7QJyt1tGBi49urMCFRUoDQuN+vSfKnHg=="}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:49:20.808396 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-58e2b1f4-f306-4bd8-997a-abf6adc7f8dc tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Getting quotas for project 9c90246f01ad410ea9569c51eb5f2ecb. Resources: {'key_pairs'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:49:20.816665 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-58e2b1f4-f306-4bd8-997a-abf6adc7f8dc tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Getting quotas for user 3477f21462c84759b0762cf13427b3c8 and project 9c90246f01ad410ea9569c51eb5f2ecb. Resources: {'key_pairs'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:49:20.853948 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-58e2b1f4-f306-4bd8-997a-abf6adc7f8dc tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.447240 Jun 24 09:49:20.861383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 440/859] 10.222.0.65 () {60 vars in 1158 bytes} [Fri Jun 24 09:49:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:49:21.337322 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-39f85f6b-865d-4280-85e2-ebf1d258a7f6 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:21.339538 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-39f85f6b-865d-4280-85e2-ebf1d258a7f6 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:21.349282 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-39f85f6b-865d-4280-85e2-ebf1d258a7f6 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:21.350448 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-39f85f6b-865d-4280-85e2-ebf1d258a7f6 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:21.351720 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-39f85f6b-865d-4280-85e2-ebf1d258a7f6 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:21.352155 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-39f85f6b-865d-4280-85e2-ebf1d258a7f6 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:21.675044 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-c028502e-0693-4da1-9b9f-e0528572be51 req-ed3b13ef-4033-46e1-98fc-ba2e2769681d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e6afd14-78c2-4765-b7ed-dfd75579caad", "name": "network-vif-plugged", "status": "completed", "tag": "c5dfd2a6-c3d5-4903-bff2-2f159ad63caf"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:49:21.676140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-39f85f6b-865d-4280-85e2-ebf1d258a7f6 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:21.696364 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-c028502e-0693-4da1-9b9f-e0528572be51 req-ed3b13ef-4033-46e1-98fc-ba2e2769681d service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:21.697388 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-c028502e-0693-4da1-9b9f-e0528572be51 req-ed3b13ef-4033-46e1-98fc-ba2e2769681d service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:21.711986 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-39f85f6b-865d-4280-85e2-ebf1d258a7f6 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 200 len: 1265 microversion: 2.1 time: 0.379773 Jun 24 09:49:21.712908 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 420/860] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:21 2022] GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 1265 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:21.723811 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-c028502e-0693-4da1-9b9f-e0528572be51 req-ed3b13ef-4033-46e1-98fc-ba2e2769681d service nova] Creating event network-vif-plugged:c5dfd2a6-c3d5-4903-bff2-2f159ad63caf for instance 4e6afd14-78c2-4765-b7ed-dfd75579caad on hv-cinder-80382 Jun 24 09:49:21.730286 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-c028502e-0693-4da1-9b9f-e0528572be51 req-ed3b13ef-4033-46e1-98fc-ba2e2769681d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061022 Jun 24 09:49:21.731842 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 441/861] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:49:22.729902 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-136e1cbb-5f68-4d88-9d64-ac6cd2c713de tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:22.730548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-136e1cbb-5f68-4d88-9d64-ac6cd2c713de tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:22.737562 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-136e1cbb-5f68-4d88-9d64-ac6cd2c713de tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:22.738393 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-136e1cbb-5f68-4d88-9d64-ac6cd2c713de tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:22.739442 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-136e1cbb-5f68-4d88-9d64-ac6cd2c713de tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:22.740098 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-136e1cbb-5f68-4d88-9d64-ac6cd2c713de tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:22.937354 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-8f27103d-94df-4756-867b-0abcc7373c84 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1328834135", "imageRef": "844ad823-18a2-4abc-813c-2d1825141591", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "947f6d7f-3e32-4a48-824a-af7e926d3402"}], "security_groups": [{"name": "tempest-securitygroup--943490071"}], "key_name": "tempest-keypair-1341101253", "user_data": "}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:49:22.944656 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-136e1cbb-5f68-4d88-9d64-ac6cd2c713de tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:22.957384 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-136e1cbb-5f68-4d88-9d64-ac6cd2c713de tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 200 len: 1265 microversion: 2.1 time: 0.231239 Jun 24 09:49:22.967170 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 421/862] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:22 2022] GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:23.092370 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.network.neutron [None req-8f27103d-94df-4756-867b-0abcc7373c84 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] validate_networks() for [('947f6d7f-3e32-4a48-824a-af7e926d3402', None, None, None, None, None)] {{(pid=124339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:49:23.977276 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-363ef41e-1d1b-45bb-9e8a-d981e0994c53 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:23.977845 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-363ef41e-1d1b-45bb-9e8a-d981e0994c53 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:23.998922 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-8f27103d-94df-4756-867b-0abcc7373c84 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Flavor limits 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:49:24.000843 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-8f27103d-94df-4756-867b-0abcc7373c84 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Image limits 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:49:24.001915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-8f27103d-94df-4756-867b-0abcc7373c84 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Flavor pref 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:49:24.002965 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-8f27103d-94df-4756-867b-0abcc7373c84 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Image pref 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:49:24.003342 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-363ef41e-1d1b-45bb-9e8a-d981e0994c53 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:24.004190 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-8f27103d-94df-4756-867b-0abcc7373c84 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:49:24.005620 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-363ef41e-1d1b-45bb-9e8a-d981e0994c53 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:24.006494 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-363ef41e-1d1b-45bb-9e8a-d981e0994c53 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:24.006998 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-363ef41e-1d1b-45bb-9e8a-d981e0994c53 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:24.018675 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8f27103d-94df-4756-867b-0abcc7373c84 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:24.019482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8f27103d-94df-4756-867b-0abcc7373c84 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:24.020504 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8f27103d-94df-4756-867b-0abcc7373c84 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:24.021036 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8f27103d-94df-4756-867b-0abcc7373c84 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:24.045483 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-8f27103d-94df-4756-867b-0abcc7373c84 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Getting quotas for project 9c90246f01ad410ea9569c51eb5f2ecb. Resources: {'cores', 'ram', 'instances'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:49:24.051053 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-8f27103d-94df-4756-867b-0abcc7373c84 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Getting quotas for user 3477f21462c84759b0762cf13427b3c8 and project 9c90246f01ad410ea9569c51eb5f2ecb. Resources: {'cores', 'ram', 'instances'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:49:24.069099 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-8f27103d-94df-4756-867b-0abcc7373c84 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Going to run 1 instances... {{(pid=124339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:49:24.072413 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-8f27103d-94df-4756-867b-0abcc7373c84 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='844ad823-18a2-4abc-813c-2d1825141591',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:49:24.134392 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-8f27103d-94df-4756-867b-0abcc7373c84 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.202615 Jun 24 09:49:24.136091 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 442/863] 10.222.0.65 () {60 vars in 1146 bytes} [Fri Jun 24 09:49:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 09:49:24.149128 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-988acde4-dce2-4540-8c84-e7f29dbfd5f0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:24.150151 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-988acde4-dce2-4540-8c84-e7f29dbfd5f0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:24.245750 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-988acde4-dce2-4540-8c84-e7f29dbfd5f0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:24.263613 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-363ef41e-1d1b-45bb-9e8a-d981e0994c53 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:24.268161 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-988acde4-dce2-4540-8c84-e7f29dbfd5f0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1238 microversion: 2.1 time: 0.123177 Jun 24 09:49:24.268777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 443/864] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:24 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1238 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:24.276706 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-363ef41e-1d1b-45bb-9e8a-d981e0994c53 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 200 len: 1452 microversion: 2.1 time: 0.302087 Jun 24 09:49:24.291856 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b7ebda46-68df-4d79-ae18-d42268d14bb2 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:24.292479 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-b7ebda46-68df-4d79-ae18-d42268d14bb2 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:24.298639 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 422/865] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:23 2022] GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 1452 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:49:24.302760 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b7ebda46-68df-4d79-ae18-d42268d14bb2 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:24.303286 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b7ebda46-68df-4d79-ae18-d42268d14bb2 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:24.304202 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b7ebda46-68df-4d79-ae18-d42268d14bb2 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:24.305687 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b7ebda46-68df-4d79-ae18-d42268d14bb2 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:24.504444 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-b7ebda46-68df-4d79-ae18-d42268d14bb2 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:24.514120 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b7ebda46-68df-4d79-ae18-d42268d14bb2 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 200 len: 1452 microversion: 2.1 time: 0.226971 Jun 24 09:49:24.519120 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 444/866] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:24 2022] GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 1452 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:49:25.286500 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-0cef5de6-546c-457d-a5d9-7cda738ea33b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:25.287155 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-0cef5de6-546c-457d-a5d9-7cda738ea33b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:25.302826 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0cef5de6-546c-457d-a5d9-7cda738ea33b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:25.303313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0cef5de6-546c-457d-a5d9-7cda738ea33b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:25.305560 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0cef5de6-546c-457d-a5d9-7cda738ea33b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:25.306205 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0cef5de6-546c-457d-a5d9-7cda738ea33b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:25.444588 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-0cef5de6-546c-457d-a5d9-7cda738ea33b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:25.456527 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-0cef5de6-546c-457d-a5d9-7cda738ea33b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1290 microversion: 2.1 time: 0.174159 Jun 24 09:49:25.458789 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 423/867] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:25 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1290 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:26.478645 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-640bff1a-d5c9-4eb8-980c-7b94d86bd022 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:26.479996 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-640bff1a-d5c9-4eb8-980c-7b94d86bd022 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:26.491110 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-640bff1a-d5c9-4eb8-980c-7b94d86bd022 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:26.491577 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-640bff1a-d5c9-4eb8-980c-7b94d86bd022 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:26.492378 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-640bff1a-d5c9-4eb8-980c-7b94d86bd022 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:26.492848 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-640bff1a-d5c9-4eb8-980c-7b94d86bd022 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:26.673185 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-640bff1a-d5c9-4eb8-980c-7b94d86bd022 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:26.683496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-640bff1a-d5c9-4eb8-980c-7b94d86bd022 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1296 microversion: 2.1 time: 0.209027 Jun 24 09:49:26.684383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 445/868] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:26 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1296 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:27.246578 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-636d1d40-53bf-4b24-8153-686cbf814012 req-e02ae8c8-7c66-4377-855b-61b2c14cb458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e6afd14-78c2-4765-b7ed-dfd75579caad", "tag": "c5dfd2a6-c3d5-4903-bff2-2f159ad63caf"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:49:27.281345 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-636d1d40-53bf-4b24-8153-686cbf814012 req-e02ae8c8-7c66-4377-855b-61b2c14cb458 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:27.281903 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-636d1d40-53bf-4b24-8153-686cbf814012 req-e02ae8c8-7c66-4377-855b-61b2c14cb458 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:27.303364 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-636d1d40-53bf-4b24-8153-686cbf814012 req-e02ae8c8-7c66-4377-855b-61b2c14cb458 service nova] Creating event network-changed:c5dfd2a6-c3d5-4903-bff2-2f159ad63caf for instance 4e6afd14-78c2-4765-b7ed-dfd75579caad on hv-cinder-80382 Jun 24 09:49:27.316229 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-636d1d40-53bf-4b24-8153-686cbf814012 req-e02ae8c8-7c66-4377-855b-61b2c14cb458 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073513 Jun 24 09:49:27.317552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 424/869] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:49:27.702375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-5c2de5ce-2804-4ce8-9e5d-c405957d5829 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:27.703800 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-5c2de5ce-2804-4ce8-9e5d-c405957d5829 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:27.712466 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5c2de5ce-2804-4ce8-9e5d-c405957d5829 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:27.713192 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5c2de5ce-2804-4ce8-9e5d-c405957d5829 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:27.714184 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5c2de5ce-2804-4ce8-9e5d-c405957d5829 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:27.714851 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5c2de5ce-2804-4ce8-9e5d-c405957d5829 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:28.277956 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-5c2de5ce-2804-4ce8-9e5d-c405957d5829 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:28.292875 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-5c2de5ce-2804-4ce8-9e5d-c405957d5829 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1363 microversion: 2.1 time: 0.594429 Jun 24 09:49:28.295536 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 446/870] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:27 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1363 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:29.312553 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-503dc16c-a02d-46b9-b0d7-d15443cd45ce tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:29.313276 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-503dc16c-a02d-46b9-b0d7-d15443cd45ce tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:29.320426 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-503dc16c-a02d-46b9-b0d7-d15443cd45ce tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:29.320988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-503dc16c-a02d-46b9-b0d7-d15443cd45ce tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:29.321730 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-503dc16c-a02d-46b9-b0d7-d15443cd45ce tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:29.322196 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-503dc16c-a02d-46b9-b0d7-d15443cd45ce tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:29.642203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-503dc16c-a02d-46b9-b0d7-d15443cd45ce tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:29.645597 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-521ad334-abb5-45d9-92b8-ca94c3d02369 req-c805b25f-f158-4a0b-af27-a9401057d615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5447c85-6da6-43c6-932d-51bd5ddb6577", "tag": "6ccc9a50-deba-4fe7-9a3d-7559860e9eb5"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:49:29.664805 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-503dc16c-a02d-46b9-b0d7-d15443cd45ce tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1363 microversion: 2.1 time: 0.357353 Jun 24 09:49:29.675406 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-521ad334-abb5-45d9-92b8-ca94c3d02369 req-c805b25f-f158-4a0b-af27-a9401057d615 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:29.676241 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-521ad334-abb5-45d9-92b8-ca94c3d02369 req-c805b25f-f158-4a0b-af27-a9401057d615 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:29.678962 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 425/871] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:29 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1363 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:29.700908 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-521ad334-abb5-45d9-92b8-ca94c3d02369 req-c805b25f-f158-4a0b-af27-a9401057d615 service nova] Creating event network-changed:6ccc9a50-deba-4fe7-9a3d-7559860e9eb5 for instance a5447c85-6da6-43c6-932d-51bd5ddb6577 on hv-cinder-80382 Jun 24 09:49:29.706755 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-521ad334-abb5-45d9-92b8-ca94c3d02369 req-c805b25f-f158-4a0b-af27-a9401057d615 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068401 Jun 24 09:49:29.716474 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 447/872] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:49:30.685981 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-c7cae689-ad70-4e7a-a90a-26de217ecfa9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:30.686997 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-c7cae689-ad70-4e7a-a90a-26de217ecfa9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:30.693851 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c7cae689-ad70-4e7a-a90a-26de217ecfa9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:30.694483 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c7cae689-ad70-4e7a-a90a-26de217ecfa9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:30.695386 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c7cae689-ad70-4e7a-a90a-26de217ecfa9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:30.696045 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c7cae689-ad70-4e7a-a90a-26de217ecfa9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:30.883511 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-c7cae689-ad70-4e7a-a90a-26de217ecfa9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:30.891915 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-c7cae689-ad70-4e7a-a90a-26de217ecfa9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1363 microversion: 2.1 time: 0.210702 Jun 24 09:49:30.892513 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 426/873] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:30 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:31.912017 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-6689096c-29d9-4af3-976d-62164c523c36 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:31.913478 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-6689096c-29d9-4af3-976d-62164c523c36 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:31.916504 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:31.924664 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6689096c-29d9-4af3-976d-62164c523c36 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:31.925227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6689096c-29d9-4af3-976d-62164c523c36 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:31.934870 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6689096c-29d9-4af3-976d-62164c523c36 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:31.935738 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6689096c-29d9-4af3-976d-62164c523c36 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:31.940882 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:32.275863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6689096c-29d9-4af3-976d-62164c523c36 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:32.286493 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-6689096c-29d9-4af3-976d-62164c523c36 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1363 microversion: 2.1 time: 0.380700 Jun 24 09:49:32.296624 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 448/874] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:31 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1363 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:33.304733 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-da92b0c0-0da2-4259-9e8c-40433427cae6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:33.305311 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-da92b0c0-0da2-4259-9e8c-40433427cae6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:33.307865 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:33.313966 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-da92b0c0-0da2-4259-9e8c-40433427cae6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:33.314411 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-da92b0c0-0da2-4259-9e8c-40433427cae6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:33.315249 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-da92b0c0-0da2-4259-9e8c-40433427cae6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:33.315678 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-da92b0c0-0da2-4259-9e8c-40433427cae6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:33.319140 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=97 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:33.446425 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-da92b0c0-0da2-4259-9e8c-40433427cae6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:33.454824 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-da92b0c0-0da2-4259-9e8c-40433427cae6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1363 microversion: 2.1 time: 0.154089 Jun 24 09:49:33.455437 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 427/875] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:33 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:34.474552 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-522655e6-aed9-46fe-bf58-8b9d906afb55 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:34.476247 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-522655e6-aed9-46fe-bf58-8b9d906afb55 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:34.480463 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=2 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:34.483166 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=12 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:34.494924 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-522655e6-aed9-46fe-bf58-8b9d906afb55 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:34.495660 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-522655e6-aed9-46fe-bf58-8b9d906afb55 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:34.496819 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-522655e6-aed9-46fe-bf58-8b9d906afb55 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:34.498719 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-522655e6-aed9-46fe-bf58-8b9d906afb55 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:34.697494 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-522655e6-aed9-46fe-bf58-8b9d906afb55 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:34.706311 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-522655e6-aed9-46fe-bf58-8b9d906afb55 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1363 microversion: 2.1 time: 0.237268 Jun 24 09:49:34.708762 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 449/876] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:34 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:35.677919 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-8139fb45-95da-4139-b8c4-359d7a2ef874 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Action: 'create', calling method: .version_select at 0x7fc6d4d66b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1010644307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDX7wlJQNJRrrSRfcadN0IiJPNif5VJqi/ZPoqDmIV9Y6TZ/A79LxWTQDRH+BBn1dlCh2hqTlrR3DL2Ve+pwQf/vVA6sXqUoX95rMMDdpAEjs3yXMDZmPDgOjDk64btgTw=="}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:49:35.693327 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-8139fb45-95da-4139-b8c4-359d7a2ef874 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Getting quotas for project 47cfee44c4264b0a8cfb5a93b7f5378a. Resources: {'key_pairs'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:49:35.697177 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-8139fb45-95da-4139-b8c4-359d7a2ef874 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Getting quotas for user b2c58a25e4cc44a8b1fd9e1edfabdc02 and project 47cfee44c4264b0a8cfb5a93b7f5378a. Resources: {'key_pairs'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:49:35.726325 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-8139fb45-95da-4139-b8c4-359d7a2ef874 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.251034 Jun 24 09:49:35.726598 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-eb9e7143-5f22-4315-9ee8-bc919ed9de7b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:35.727029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-eb9e7143-5f22-4315-9ee8-bc919ed9de7b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:35.728509 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 428/877] 10.222.0.65 () {60 vars in 1158 bytes} [Fri Jun 24 09:49:35 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:49:35.734987 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eb9e7143-5f22-4315-9ee8-bc919ed9de7b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:35.735695 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eb9e7143-5f22-4315-9ee8-bc919ed9de7b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:35.736704 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eb9e7143-5f22-4315-9ee8-bc919ed9de7b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:35.737112 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eb9e7143-5f22-4315-9ee8-bc919ed9de7b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:35.890974 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-eb9e7143-5f22-4315-9ee8-bc919ed9de7b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:35.900244 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-eb9e7143-5f22-4315-9ee8-bc919ed9de7b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1363 microversion: 2.1 time: 0.178039 Jun 24 09:49:35.900831 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 450/878] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:35 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:36.159507 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-5b41ba32-2723-4a46-b42a-de7db3733257 req-1bf8f71e-cc16-44a5-bec2-869dfdaf71a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5447c85-6da6-43c6-932d-51bd5ddb6577", "name": "network-vif-plugged", "status": "completed", "tag": "6ccc9a50-deba-4fe7-9a3d-7559860e9eb5"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:49:36.174530 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-5b41ba32-2723-4a46-b42a-de7db3733257 req-1bf8f71e-cc16-44a5-bec2-869dfdaf71a9 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:36.175555 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-5b41ba32-2723-4a46-b42a-de7db3733257 req-1bf8f71e-cc16-44a5-bec2-869dfdaf71a9 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:36.196091 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-5b41ba32-2723-4a46-b42a-de7db3733257 req-1bf8f71e-cc16-44a5-bec2-869dfdaf71a9 service nova] Creating event network-vif-plugged:6ccc9a50-deba-4fe7-9a3d-7559860e9eb5 for instance a5447c85-6da6-43c6-932d-51bd5ddb6577 on hv-cinder-80382 Jun 24 09:49:36.205151 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-5b41ba32-2723-4a46-b42a-de7db3733257 req-1bf8f71e-cc16-44a5-bec2-869dfdaf71a9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047736 Jun 24 09:49:36.205151 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 429/879] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:49:36.918099 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-26724426-8633-453c-9526-c5086c217167 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:36.919193 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-26724426-8633-453c-9526-c5086c217167 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:36.925851 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-26724426-8633-453c-9526-c5086c217167 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:36.926301 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-26724426-8633-453c-9526-c5086c217167 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:36.927175 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-26724426-8633-453c-9526-c5086c217167 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:36.927565 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-26724426-8633-453c-9526-c5086c217167 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:37.098248 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-26724426-8633-453c-9526-c5086c217167 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:37.108671 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-26724426-8633-453c-9526-c5086c217167 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1363 microversion: 2.1 time: 0.194260 Jun 24 09:49:37.109244 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 451/880] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:36 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:38.133049 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ebf7eed3-7458-41ec-9397-1ae3ee165f49 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:38.133769 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ebf7eed3-7458-41ec-9397-1ae3ee165f49 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:38.141208 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ebf7eed3-7458-41ec-9397-1ae3ee165f49 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:38.141657 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ebf7eed3-7458-41ec-9397-1ae3ee165f49 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:38.142438 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ebf7eed3-7458-41ec-9397-1ae3ee165f49 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:38.142886 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ebf7eed3-7458-41ec-9397-1ae3ee165f49 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:38.285689 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ebf7eed3-7458-41ec-9397-1ae3ee165f49 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:38.293839 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ebf7eed3-7458-41ec-9397-1ae3ee165f49 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1548 microversion: 2.1 time: 0.167892 Jun 24 09:49:38.294442 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 430/881] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:38 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:38.310674 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-768fee13-167c-4f14-9a26-69d56d79061e tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:38.311233 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-768fee13-167c-4f14-9a26-69d56d79061e tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:38.318206 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-768fee13-167c-4f14-9a26-69d56d79061e tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:38.318663 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-768fee13-167c-4f14-9a26-69d56d79061e tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:38.319477 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-768fee13-167c-4f14-9a26-69d56d79061e tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:38.319912 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-768fee13-167c-4f14-9a26-69d56d79061e tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:38.404537 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-768fee13-167c-4f14-9a26-69d56d79061e tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097770 Jun 24 09:49:38.405148 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 452/882] 10.222.0.65 () {58 vars in 1274 bytes} [Fri Jun 24 09:49:38 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:49:39.679341 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-1afe8eca-99c5-47a5-aaa4-9379c5a0c5b8 req-4db8b379-b68c-49d8-bafb-3b9170ce8d8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5447c85-6da6-43c6-932d-51bd5ddb6577", "tag": "6ccc9a50-deba-4fe7-9a3d-7559860e9eb5"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:49:39.688250 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-1afe8eca-99c5-47a5-aaa4-9379c5a0c5b8 req-4db8b379-b68c-49d8-bafb-3b9170ce8d8b service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:39.688707 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-1afe8eca-99c5-47a5-aaa4-9379c5a0c5b8 req-4db8b379-b68c-49d8-bafb-3b9170ce8d8b service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:39.700879 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-1afe8eca-99c5-47a5-aaa4-9379c5a0c5b8 req-4db8b379-b68c-49d8-bafb-3b9170ce8d8b service nova] Creating event network-changed:6ccc9a50-deba-4fe7-9a3d-7559860e9eb5 for instance a5447c85-6da6-43c6-932d-51bd5ddb6577 on hv-cinder-80382 Jun 24 09:49:39.705993 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-1afe8eca-99c5-47a5-aaa4-9379c5a0c5b8 req-4db8b379-b68c-49d8-bafb-3b9170ce8d8b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030637 Jun 24 09:49:39.707241 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 431/883] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:49:51.087577 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=9 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:51.088338 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=27 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:51.093177 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c4514d09-b650-47dd-a173-8cadf766df30 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1265224331", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1010644307", "security_groups": [{"name": "tempest-secgroup-smoke-714164895"}], "networks": [{"uuid": "4c183d41-68d9-4ee6-a230-d5b9c4829714"}], "block_device_mapping_v2": [{"uuid": "b9f6021a-2403-4a29-8209-775c7afc6785", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:49:51.212952 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.network.neutron [None req-c4514d09-b650-47dd-a173-8cadf766df30 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] validate_networks() for [('4c183d41-68d9-4ee6-a230-d5b9c4829714', None, None, None, None, None)] {{(pid=124339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:49:51.588104 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-c4514d09-b650-47dd-a173-8cadf766df30 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Flavor limits 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:49:51.588548 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-c4514d09-b650-47dd-a173-8cadf766df30 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Image limits 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:49:51.588997 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-c4514d09-b650-47dd-a173-8cadf766df30 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Flavor pref 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:49:51.589918 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-c4514d09-b650-47dd-a173-8cadf766df30 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Image pref 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:49:51.590306 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-c4514d09-b650-47dd-a173-8cadf766df30 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:49:51.600720 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c4514d09-b650-47dd-a173-8cadf766df30 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:51.601166 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c4514d09-b650-47dd-a173-8cadf766df30 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:51.601957 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c4514d09-b650-47dd-a173-8cadf766df30 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:51.602388 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c4514d09-b650-47dd-a173-8cadf766df30 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:51.620235 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-c4514d09-b650-47dd-a173-8cadf766df30 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Getting quotas for project 47cfee44c4264b0a8cfb5a93b7f5378a. Resources: {'cores', 'ram', 'instances'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:49:51.624998 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-c4514d09-b650-47dd-a173-8cadf766df30 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Getting quotas for user b2c58a25e4cc44a8b1fd9e1edfabdc02 and project 47cfee44c4264b0a8cfb5a93b7f5378a. Resources: {'cores', 'ram', 'instances'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:49:51.688954 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-c4514d09-b650-47dd-a173-8cadf766df30 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Going to run 1 instances... {{(pid=124339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:49:51.691236 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-c4514d09-b650-47dd-a173-8cadf766df30 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b9f6021a-2403-4a29-8209-775c7afc6785',volume_size=None,volume_type=None)] {{(pid=124339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:49:51.835450 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-c4514d09-b650-47dd-a173-8cadf766df30 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.749145 Jun 24 09:49:51.836153 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 453/884] 10.222.0.65 () {60 vars in 1146 bytes} [Fri Jun 24 09:49:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 09:49:51.844707 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=4 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:51.846107 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:51.846823 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=15 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:51.851007 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-0215e4be-9211-4c4a-9b0c-a841c9679450 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:51.851850 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-0215e4be-9211-4c4a-9b0c-a841c9679450 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:51.909505 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-0215e4be-9211-4c4a-9b0c-a841c9679450 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:51.916412 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-0215e4be-9211-4c4a-9b0c-a841c9679450 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1089 microversion: 2.1 time: 0.073289 Jun 24 09:49:51.916999 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 432/885] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:51 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1089 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:52.935560 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-87961e65-516c-40fe-a63f-b70b04ded879 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:52.936882 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-87961e65-516c-40fe-a63f-b70b04ded879 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:52.947485 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-87961e65-516c-40fe-a63f-b70b04ded879 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:52.948088 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-87961e65-516c-40fe-a63f-b70b04ded879 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:52.948962 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-87961e65-516c-40fe-a63f-b70b04ded879 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:52.949496 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-87961e65-516c-40fe-a63f-b70b04ded879 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:53.053593 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-87961e65-516c-40fe-a63f-b70b04ded879 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:53.061940 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-87961e65-516c-40fe-a63f-b70b04ded879 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1195 microversion: 2.1 time: 0.131754 Jun 24 09:49:53.063392 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 454/886] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:52 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1195 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:54.080127 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-82b5f47e-2cac-449b-90cc-6928d7c78957 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:54.080764 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-82b5f47e-2cac-449b-90cc-6928d7c78957 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:54.089729 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-82b5f47e-2cac-449b-90cc-6928d7c78957 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:54.090185 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-82b5f47e-2cac-449b-90cc-6928d7c78957 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:54.090979 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-82b5f47e-2cac-449b-90cc-6928d7c78957 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:54.091562 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-82b5f47e-2cac-449b-90cc-6928d7c78957 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:54.308244 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-82b5f47e-2cac-449b-90cc-6928d7c78957 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:54.316658 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-82b5f47e-2cac-449b-90cc-6928d7c78957 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1260 microversion: 2.1 time: 0.241649 Jun 24 09:49:54.317240 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 433/887] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:54 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1260 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:54.945418 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-5fd625bd-f67d-49f6-8a59-61963ed800a6 req-e02831db-28cf-4d55-9cea-d4c8f531e714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7a737cc-6f16-413d-9b3a-d6d32381ffa5", "tag": "ab20f504-ef6d-409e-9d0c-3918f4bb9c57"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:49:54.957241 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-5fd625bd-f67d-49f6-8a59-61963ed800a6 req-e02831db-28cf-4d55-9cea-d4c8f531e714 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:54.957700 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-5fd625bd-f67d-49f6-8a59-61963ed800a6 req-e02831db-28cf-4d55-9cea-d4c8f531e714 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:54.978823 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-5fd625bd-f67d-49f6-8a59-61963ed800a6 req-e02831db-28cf-4d55-9cea-d4c8f531e714 service nova] Creating event network-changed:ab20f504-ef6d-409e-9d0c-3918f4bb9c57 for instance e7a737cc-6f16-413d-9b3a-d6d32381ffa5 on hv-cinder-80382 Jun 24 09:49:54.985035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-5fd625bd-f67d-49f6-8a59-61963ed800a6 req-e02831db-28cf-4d55-9cea-d4c8f531e714 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046716 Jun 24 09:49:54.985920 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 455/888] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:49:55.334242 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-583cf6c4-b12c-40a4-8e85-b8582403c4eb tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:55.334857 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-583cf6c4-b12c-40a4-8e85-b8582403c4eb tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:55.342591 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-583cf6c4-b12c-40a4-8e85-b8582403c4eb tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:55.343045 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-583cf6c4-b12c-40a4-8e85-b8582403c4eb tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:55.343900 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-583cf6c4-b12c-40a4-8e85-b8582403c4eb tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:55.344334 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-583cf6c4-b12c-40a4-8e85-b8582403c4eb tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:55.481027 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-583cf6c4-b12c-40a4-8e85-b8582403c4eb tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:55.489105 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-583cf6c4-b12c-40a4-8e85-b8582403c4eb tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1260 microversion: 2.1 time: 0.158835 Jun 24 09:49:55.489669 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 434/889] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:55 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:56.507838 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-aab3883f-8be4-4d09-a105-35258fb18149 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:56.508545 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-aab3883f-8be4-4d09-a105-35258fb18149 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:56.515588 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-aab3883f-8be4-4d09-a105-35258fb18149 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:56.516034 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-aab3883f-8be4-4d09-a105-35258fb18149 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:56.516787 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-aab3883f-8be4-4d09-a105-35258fb18149 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:56.517236 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-aab3883f-8be4-4d09-a105-35258fb18149 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:56.658040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-aab3883f-8be4-4d09-a105-35258fb18149 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:56.666079 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-aab3883f-8be4-4d09-a105-35258fb18149 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1260 microversion: 2.1 time: 0.163257 Jun 24 09:49:56.666648 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 456/890] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:56 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:57.683568 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-d6823ece-6aaf-4c6d-9088-2c1ad10d8a6a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:57.684205 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-d6823ece-6aaf-4c6d-9088-2c1ad10d8a6a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:57.691831 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d6823ece-6aaf-4c6d-9088-2c1ad10d8a6a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:57.692294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d6823ece-6aaf-4c6d-9088-2c1ad10d8a6a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:57.693072 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d6823ece-6aaf-4c6d-9088-2c1ad10d8a6a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:57.693507 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d6823ece-6aaf-4c6d-9088-2c1ad10d8a6a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:57.830091 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d6823ece-6aaf-4c6d-9088-2c1ad10d8a6a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:57.838105 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-d6823ece-6aaf-4c6d-9088-2c1ad10d8a6a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1260 microversion: 2.1 time: 0.158587 Jun 24 09:49:57.838688 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 435/891] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:57 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:49:58.855506 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-cb901503-0ef3-4590-a070-696f7b6746e8 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:49:58.856117 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-cb901503-0ef3-4590-a070-696f7b6746e8 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:49:58.863104 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-cb901503-0ef3-4590-a070-696f7b6746e8 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:58.863598 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-cb901503-0ef3-4590-a070-696f7b6746e8 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:58.864381 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-cb901503-0ef3-4590-a070-696f7b6746e8 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:49:58.864855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-cb901503-0ef3-4590-a070-696f7b6746e8 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:49:59.003903 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-cb901503-0ef3-4590-a070-696f7b6746e8 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:49:59.012003 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-cb901503-0ef3-4590-a070-696f7b6746e8 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1260 microversion: 2.1 time: 0.160583 Jun 24 09:49:59.012677 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 457/892] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:49:58 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:50:00.030064 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-cc21c0fa-33f4-4318-bbae-5b2bf7931425 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:00.030685 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-cc21c0fa-33f4-4318-bbae-5b2bf7931425 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:00.037691 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-cc21c0fa-33f4-4318-bbae-5b2bf7931425 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:00.038143 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-cc21c0fa-33f4-4318-bbae-5b2bf7931425 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:00.038930 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-cc21c0fa-33f4-4318-bbae-5b2bf7931425 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:00.039636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-cc21c0fa-33f4-4318-bbae-5b2bf7931425 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:00.172499 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-cc21c0fa-33f4-4318-bbae-5b2bf7931425 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:50:00.180311 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-cc21c0fa-33f4-4318-bbae-5b2bf7931425 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1260 microversion: 2.1 time: 0.154530 Jun 24 09:50:00.180899 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 436/893] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:50:00 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:50:01.197730 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c6687759-0abf-4bf2-ac0e-b563a2bc15ef tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:01.198375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-c6687759-0abf-4bf2-ac0e-b563a2bc15ef tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:01.205793 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c6687759-0abf-4bf2-ac0e-b563a2bc15ef tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:01.206247 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c6687759-0abf-4bf2-ac0e-b563a2bc15ef tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:01.207031 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c6687759-0abf-4bf2-ac0e-b563a2bc15ef tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:01.207516 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c6687759-0abf-4bf2-ac0e-b563a2bc15ef tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:01.346645 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c6687759-0abf-4bf2-ac0e-b563a2bc15ef tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:50:01.354706 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-c6687759-0abf-4bf2-ac0e-b563a2bc15ef tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1260 microversion: 2.1 time: 0.160993 Jun 24 09:50:01.355309 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 458/894] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:50:01 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:50:02.373142 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-06be9741-1deb-4c66-a73a-829e3b81511b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:02.373728 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-06be9741-1deb-4c66-a73a-829e3b81511b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:02.376179 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=2 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:50:02.381893 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-06be9741-1deb-4c66-a73a-829e3b81511b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:02.382358 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-06be9741-1deb-4c66-a73a-829e3b81511b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:02.383186 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-06be9741-1deb-4c66-a73a-829e3b81511b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:02.383630 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-06be9741-1deb-4c66-a73a-829e3b81511b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:02.522995 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-06be9741-1deb-4c66-a73a-829e3b81511b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:50:02.530959 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-06be9741-1deb-4c66-a73a-829e3b81511b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1260 microversion: 2.1 time: 0.162096 Jun 24 09:50:02.531574 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 437/895] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:50:02 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:50:03.548798 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-883002dc-149c-47ce-853f-eb8b0446882f tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:03.549390 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-883002dc-149c-47ce-853f-eb8b0446882f tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:03.551600 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=2 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:50:03.552273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=6 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:50:03.558854 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-883002dc-149c-47ce-853f-eb8b0446882f tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:03.559430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-883002dc-149c-47ce-853f-eb8b0446882f tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:03.560227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-883002dc-149c-47ce-853f-eb8b0446882f tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:03.560649 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-883002dc-149c-47ce-853f-eb8b0446882f tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:03.702856 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-883002dc-149c-47ce-853f-eb8b0446882f tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:50:03.710669 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-883002dc-149c-47ce-853f-eb8b0446882f tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1260 microversion: 2.1 time: 0.165935 Jun 24 09:50:03.711417 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 459/896] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:50:03 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:50:04.728474 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-a79ef153-2f78-4266-8210-fc87dfc9ed90 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:04.729104 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-a79ef153-2f78-4266-8210-fc87dfc9ed90 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:04.736355 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a79ef153-2f78-4266-8210-fc87dfc9ed90 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:04.736806 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a79ef153-2f78-4266-8210-fc87dfc9ed90 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:04.737590 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a79ef153-2f78-4266-8210-fc87dfc9ed90 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:04.738030 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a79ef153-2f78-4266-8210-fc87dfc9ed90 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:04.875113 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-a79ef153-2f78-4266-8210-fc87dfc9ed90 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:50:04.883107 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-a79ef153-2f78-4266-8210-fc87dfc9ed90 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1260 microversion: 2.1 time: 0.158537 Jun 24 09:50:04.883703 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 438/897] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:50:04 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:50:05.855566 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-3409a872-c48e-4d91-ba4a-33c1ffe00fb4 req-63a2d83a-36e0-442b-8dca-a748747daed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a737cc-6f16-413d-9b3a-d6d32381ffa5", "name": "network-vif-plugged", "status": "completed", "tag": "ab20f504-ef6d-409e-9d0c-3918f4bb9c57"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:50:05.866041 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-3409a872-c48e-4d91-ba4a-33c1ffe00fb4 req-63a2d83a-36e0-442b-8dca-a748747daed2 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:05.866216 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-3409a872-c48e-4d91-ba4a-33c1ffe00fb4 req-63a2d83a-36e0-442b-8dca-a748747daed2 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:05.878711 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-3409a872-c48e-4d91-ba4a-33c1ffe00fb4 req-63a2d83a-36e0-442b-8dca-a748747daed2 service nova] Creating event network-vif-plugged:ab20f504-ef6d-409e-9d0c-3918f4bb9c57 for instance e7a737cc-6f16-413d-9b3a-d6d32381ffa5 on hv-cinder-80382 Jun 24 09:50:05.883904 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-3409a872-c48e-4d91-ba4a-33c1ffe00fb4 req-63a2d83a-36e0-442b-8dca-a748747daed2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032492 Jun 24 09:50:05.884697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 460/898] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:50:05.900273 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-61c6a5cc-c873-48f4-84bf-00ca692613f5 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:05.900916 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-61c6a5cc-c873-48f4-84bf-00ca692613f5 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:05.909797 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-61c6a5cc-c873-48f4-84bf-00ca692613f5 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:05.910336 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-61c6a5cc-c873-48f4-84bf-00ca692613f5 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:05.911237 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-61c6a5cc-c873-48f4-84bf-00ca692613f5 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:05.911734 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-61c6a5cc-c873-48f4-84bf-00ca692613f5 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:06.050548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-61c6a5cc-c873-48f4-84bf-00ca692613f5 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:50:06.058619 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-61c6a5cc-c873-48f4-84bf-00ca692613f5 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1260 microversion: 2.1 time: 0.162229 Jun 24 09:50:06.059349 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 439/899] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:50:05 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:50:07.077745 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1cf029f3-dbcb-4a72-b5fb-692a16daec83 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:07.078321 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-1cf029f3-dbcb-4a72-b5fb-692a16daec83 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:07.085235 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1cf029f3-dbcb-4a72-b5fb-692a16daec83 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:07.085683 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1cf029f3-dbcb-4a72-b5fb-692a16daec83 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:07.086447 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1cf029f3-dbcb-4a72-b5fb-692a16daec83 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:07.086875 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1cf029f3-dbcb-4a72-b5fb-692a16daec83 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:07.237836 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-1cf029f3-dbcb-4a72-b5fb-692a16daec83 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:50:07.245752 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-1cf029f3-dbcb-4a72-b5fb-692a16daec83 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1260 microversion: 2.1 time: 0.173158 Jun 24 09:50:07.246340 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 461/900] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:50:07 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:50:08.263409 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-0941a451-e0c7-44bf-8e67-9df544689033 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:08.264004 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-0941a451-e0c7-44bf-8e67-9df544689033 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:08.271006 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0941a451-e0c7-44bf-8e67-9df544689033 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:08.271493 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0941a451-e0c7-44bf-8e67-9df544689033 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:08.272265 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0941a451-e0c7-44bf-8e67-9df544689033 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:08.272701 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0941a451-e0c7-44bf-8e67-9df544689033 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:08.417026 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-0941a451-e0c7-44bf-8e67-9df544689033 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:50:08.425345 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-0941a451-e0c7-44bf-8e67-9df544689033 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1443 microversion: 2.1 time: 0.165984 Jun 24 09:50:08.425931 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 440/901] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:50:08 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1443 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:50:08.441610 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-0d69fda1-0db9-4632-8bbe-ea22a8f0fa3d tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:08.442260 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-0d69fda1-0db9-4632-8bbe-ea22a8f0fa3d tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:08.449005 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0d69fda1-0db9-4632-8bbe-ea22a8f0fa3d tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:08.449457 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0d69fda1-0db9-4632-8bbe-ea22a8f0fa3d tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:08.450691 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0d69fda1-0db9-4632-8bbe-ea22a8f0fa3d tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:08.450816 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0d69fda1-0db9-4632-8bbe-ea22a8f0fa3d tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:08.588989 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-0d69fda1-0db9-4632-8bbe-ea22a8f0fa3d tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:50:08.597104 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-0d69fda1-0db9-4632-8bbe-ea22a8f0fa3d tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1443 microversion: 2.1 time: 0.159429 Jun 24 09:50:08.597673 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 462/902] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:50:08 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1443 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:50:10.610255 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-2282d62f-b7cb-4c21-b2dc-9738165bd1ac req-4bfb35ca-9f47-418b-b709-dd0c9e248b83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7a737cc-6f16-413d-9b3a-d6d32381ffa5", "tag": "ab20f504-ef6d-409e-9d0c-3918f4bb9c57"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:50:10.619159 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-2282d62f-b7cb-4c21-b2dc-9738165bd1ac req-4bfb35ca-9f47-418b-b709-dd0c9e248b83 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:10.619655 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-2282d62f-b7cb-4c21-b2dc-9738165bd1ac req-4bfb35ca-9f47-418b-b709-dd0c9e248b83 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:10.632127 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-2282d62f-b7cb-4c21-b2dc-9738165bd1ac req-4bfb35ca-9f47-418b-b709-dd0c9e248b83 service nova] Creating event network-changed:ab20f504-ef6d-409e-9d0c-3918f4bb9c57 for instance e7a737cc-6f16-413d-9b3a-d6d32381ffa5 on hv-cinder-80382 Jun 24 09:50:10.637310 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-2282d62f-b7cb-4c21-b2dc-9738165bd1ac req-4bfb35ca-9f47-418b-b709-dd0c9e248b83 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030791 Jun 24 09:50:10.638126 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 441/903] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:50:15.752608 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-0ba7b9d8-986f-47c1-a05c-c136910a9d64 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:15.753174 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-0ba7b9d8-986f-47c1-a05c-c136910a9d64 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:15.762188 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0ba7b9d8-986f-47c1-a05c-c136910a9d64 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:15.762910 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0ba7b9d8-986f-47c1-a05c-c136910a9d64 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:15.763862 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0ba7b9d8-986f-47c1-a05c-c136910a9d64 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:15.764349 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0ba7b9d8-986f-47c1-a05c-c136910a9d64 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:15.790148 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-0ba7b9d8-986f-47c1-a05c-c136910a9d64 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577/ips" status: 200 len: 145 microversion: 2.1 time: 0.044137 Jun 24 09:50:15.790713 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 463/904] 10.222.0.65 () {58 vars in 1247 bytes} [Fri Jun 24 09:50:15 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:50:18.834182 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-3d844f87-6d2a-411a-8a27-bc781dbb66a3 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58b96884-e755-4c04-89ff-ed59311f7dba"}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:50:18.835395 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-3d844f87-6d2a-411a-8a27-bc781dbb66a3 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:18.843212 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3d844f87-6d2a-411a-8a27-bc781dbb66a3 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:18.843673 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3d844f87-6d2a-411a-8a27-bc781dbb66a3 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:18.844464 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3d844f87-6d2a-411a-8a27-bc781dbb66a3 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:18.844908 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3d844f87-6d2a-411a-8a27-bc781dbb66a3 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:19.094300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-3d844f87-6d2a-411a-8a27-bc781dbb66a3 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "POST /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264591 Jun 24 09:50:19.095197 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 442/905] 10.222.0.65 () {60 vars in 1322 bytes} [Fri Jun 24 09:50:18 2022] POST /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:50:25.583990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a77ecaf0-747c-47e6-8836-946be30884ad tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:50:25.586624 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:50:25.593290 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a77ecaf0-747c-47e6-8836-946be30884ad tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:25.593729 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a77ecaf0-747c-47e6-8836-946be30884ad tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:25.596462 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=53 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:50:25.659365 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-a77ecaf0-747c-47e6-8836-946be30884ad tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Going to try to stop instance {{(pid=124339) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 24 09:50:25.708802 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-a77ecaf0-747c-47e6-8836-946be30884ad tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "POST /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577/action" status: 202 len: 0 microversion: 2.1 time: 0.128599 Jun 24 09:50:25.709435 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 464/906] 10.222.0.65 () {60 vars in 1277 bytes} [Fri Jun 24 09:50:25 2022] POST /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:50:25.719961 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-4bcf26d3-f020-4397-8ab0-79fe7a4abdf3 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:25.720708 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-4bcf26d3-f020-4397-8ab0-79fe7a4abdf3 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:25.722865 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=25 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:50:25.729706 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-4bcf26d3-f020-4397-8ab0-79fe7a4abdf3 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:25.730771 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-4bcf26d3-f020-4397-8ab0-79fe7a4abdf3 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:25.731723 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-4bcf26d3-f020-4397-8ab0-79fe7a4abdf3 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:25.732167 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-4bcf26d3-f020-4397-8ab0-79fe7a4abdf3 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:25.735685 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:50:25.877861 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-4bcf26d3-f020-4397-8ab0-79fe7a4abdf3 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:50:25.886462 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-4bcf26d3-f020-4397-8ab0-79fe7a4abdf3 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1723 microversion: 2.1 time: 0.171565 Jun 24 09:50:25.887196 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 443/907] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:50:25 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:50:26.906139 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-82279713-7a07-43cf-96a3-30c2907dc091 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:26.906850 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-82279713-7a07-43cf-96a3-30c2907dc091 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:26.915877 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-82279713-7a07-43cf-96a3-30c2907dc091 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:26.916653 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-82279713-7a07-43cf-96a3-30c2907dc091 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:26.917949 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-82279713-7a07-43cf-96a3-30c2907dc091 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:26.918812 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-82279713-7a07-43cf-96a3-30c2907dc091 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:27.065837 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-82279713-7a07-43cf-96a3-30c2907dc091 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:50:27.078178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-82279713-7a07-43cf-96a3-30c2907dc091 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1723 microversion: 2.1 time: 0.177071 Jun 24 09:50:27.078776 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 465/908] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:50:26 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:50:28.107319 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-81a53fda-75a7-472f-a25c-d1417f57d400 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:28.107989 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-81a53fda-75a7-472f-a25c-d1417f57d400 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:28.115758 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-81a53fda-75a7-472f-a25c-d1417f57d400 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:28.116269 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-81a53fda-75a7-472f-a25c-d1417f57d400 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:28.117164 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-81a53fda-75a7-472f-a25c-d1417f57d400 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:28.117671 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-81a53fda-75a7-472f-a25c-d1417f57d400 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:28.255192 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-81a53fda-75a7-472f-a25c-d1417f57d400 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:50:28.263806 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-81a53fda-75a7-472f-a25c-d1417f57d400 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1723 microversion: 2.1 time: 0.164256 Jun 24 09:50:28.264367 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 444/909] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:50:28 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:50:29.281576 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-951570ed-96c3-4e11-9cb2-22c24caafd8b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:29.282188 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-951570ed-96c3-4e11-9cb2-22c24caafd8b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:29.289185 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-951570ed-96c3-4e11-9cb2-22c24caafd8b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:29.289633 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-951570ed-96c3-4e11-9cb2-22c24caafd8b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:29.290409 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-951570ed-96c3-4e11-9cb2-22c24caafd8b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:29.290845 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-951570ed-96c3-4e11-9cb2-22c24caafd8b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:29.428010 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-951570ed-96c3-4e11-9cb2-22c24caafd8b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:50:29.436950 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-951570ed-96c3-4e11-9cb2-22c24caafd8b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1723 microversion: 2.1 time: 0.159533 Jun 24 09:50:29.437520 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 466/910] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:50:29 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:50:30.454227 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-31ffb6e5-7dd9-4ccb-bf30-27fec34c4744 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:30.454864 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-31ffb6e5-7dd9-4ccb-bf30-27fec34c4744 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:30.461895 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-31ffb6e5-7dd9-4ccb-bf30-27fec34c4744 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:30.462344 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-31ffb6e5-7dd9-4ccb-bf30-27fec34c4744 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:30.463542 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-31ffb6e5-7dd9-4ccb-bf30-27fec34c4744 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:30.463974 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-31ffb6e5-7dd9-4ccb-bf30-27fec34c4744 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:30.593137 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-31ffb6e5-7dd9-4ccb-bf30-27fec34c4744 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:50:30.601225 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-31ffb6e5-7dd9-4ccb-bf30-27fec34c4744 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1723 microversion: 2.1 time: 0.151107 Jun 24 09:50:30.601788 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 445/911] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:50:30 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:50:31.619377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-6d7bc25b-59fb-467a-8834-399bf624817c tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:31.620005 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-6d7bc25b-59fb-467a-8834-399bf624817c tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:31.626992 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6d7bc25b-59fb-467a-8834-399bf624817c tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:31.627476 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6d7bc25b-59fb-467a-8834-399bf624817c tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:31.628253 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6d7bc25b-59fb-467a-8834-399bf624817c tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:31.628686 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6d7bc25b-59fb-467a-8834-399bf624817c tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:31.761647 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6d7bc25b-59fb-467a-8834-399bf624817c tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:50:31.770161 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-6d7bc25b-59fb-467a-8834-399bf624817c tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1723 microversion: 2.1 time: 0.155474 Jun 24 09:50:31.770768 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 467/912] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:50:31 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:50:32.788225 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-07f76e20-56f3-4762-b8db-c88aca7ca676 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:32.788863 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-07f76e20-56f3-4762-b8db-c88aca7ca676 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:32.796079 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-07f76e20-56f3-4762-b8db-c88aca7ca676 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:32.796532 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-07f76e20-56f3-4762-b8db-c88aca7ca676 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:32.797301 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-07f76e20-56f3-4762-b8db-c88aca7ca676 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:32.797741 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-07f76e20-56f3-4762-b8db-c88aca7ca676 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:32.936476 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-07f76e20-56f3-4762-b8db-c88aca7ca676 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:50:32.944721 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-07f76e20-56f3-4762-b8db-c88aca7ca676 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1723 microversion: 2.1 time: 0.160565 Jun 24 09:50:32.945266 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 446/913] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:50:32 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:50:33.968803 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-8ac19ce3-20bd-4b49-ab6a-bef8367309a9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:33.969434 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-8ac19ce3-20bd-4b49-ab6a-bef8367309a9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:33.976828 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8ac19ce3-20bd-4b49-ab6a-bef8367309a9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:33.977288 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8ac19ce3-20bd-4b49-ab6a-bef8367309a9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:33.978135 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8ac19ce3-20bd-4b49-ab6a-bef8367309a9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:33.978572 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8ac19ce3-20bd-4b49-ab6a-bef8367309a9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:34.123909 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-8ac19ce3-20bd-4b49-ab6a-bef8367309a9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:50:34.132673 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-8ac19ce3-20bd-4b49-ab6a-bef8367309a9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1723 microversion: 2.1 time: 0.168397 Jun 24 09:50:34.133291 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 468/914] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:50:33 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:50:35.150756 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-aa30cacd-af8e-4517-aeba-abee49feef39 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:35.151360 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-aa30cacd-af8e-4517-aeba-abee49feef39 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:35.158623 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-aa30cacd-af8e-4517-aeba-abee49feef39 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:35.159100 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-aa30cacd-af8e-4517-aeba-abee49feef39 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:35.159893 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-aa30cacd-af8e-4517-aeba-abee49feef39 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:35.160329 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-aa30cacd-af8e-4517-aeba-abee49feef39 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:35.309720 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-aa30cacd-af8e-4517-aeba-abee49feef39 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:50:35.318450 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-aa30cacd-af8e-4517-aeba-abee49feef39 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1723 microversion: 2.1 time: 0.171787 Jun 24 09:50:35.319034 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 447/915] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:50:35 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:50:36.336197 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-99441414-0f4b-4d10-acfa-831dd6a43da7 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:36.336815 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-99441414-0f4b-4d10-acfa-831dd6a43da7 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:36.344700 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-99441414-0f4b-4d10-acfa-831dd6a43da7 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:36.345189 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-99441414-0f4b-4d10-acfa-831dd6a43da7 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:36.346266 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-99441414-0f4b-4d10-acfa-831dd6a43da7 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:36.346688 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-99441414-0f4b-4d10-acfa-831dd6a43da7 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:36.491026 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-99441414-0f4b-4d10-acfa-831dd6a43da7 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:50:36.500658 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-99441414-0f4b-4d10-acfa-831dd6a43da7 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1700 microversion: 2.1 time: 0.168304 Jun 24 09:50:36.501250 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 469/916] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:50:36 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1700 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:50:36.517325 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-e6964c43-9450-497c-a83a-75f3ec7378c0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:50:36.524968 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e6964c43-9450-497c-a83a-75f3ec7378c0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:36.525417 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e6964c43-9450-497c-a83a-75f3ec7378c0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:36.586317 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-e6964c43-9450-497c-a83a-75f3ec7378c0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Going to try to start instance {{(pid=124338) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 24 09:50:36.633393 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-e6964c43-9450-497c-a83a-75f3ec7378c0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "POST /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577/action" status: 202 len: 0 microversion: 2.1 time: 0.119771 Jun 24 09:50:36.634014 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 448/917] 10.222.0.65 () {60 vars in 1277 bytes} [Fri Jun 24 09:50:36 2022] POST /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 09:50:36.643755 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e8bb12e5-6536-4bc7-9398-bbb836f1f373 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:36.645008 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e8bb12e5-6536-4bc7-9398-bbb836f1f373 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:36.656565 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e8bb12e5-6536-4bc7-9398-bbb836f1f373 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:36.657203 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e8bb12e5-6536-4bc7-9398-bbb836f1f373 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:36.659629 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e8bb12e5-6536-4bc7-9398-bbb836f1f373 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:36.660088 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e8bb12e5-6536-4bc7-9398-bbb836f1f373 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:36.866428 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e8bb12e5-6536-4bc7-9398-bbb836f1f373 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:50:36.875899 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e8bb12e5-6536-4bc7-9398-bbb836f1f373 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1709 microversion: 2.1 time: 0.236326 Jun 24 09:50:36.876518 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 470/918] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:50:36 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1709 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:50:37.896352 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-48823419-d71c-4e18-952f-06db925daaaf tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:37.897088 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-48823419-d71c-4e18-952f-06db925daaaf tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:37.903839 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-48823419-d71c-4e18-952f-06db925daaaf tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:37.904312 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-48823419-d71c-4e18-952f-06db925daaaf tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:37.905157 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-48823419-d71c-4e18-952f-06db925daaaf tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:37.905588 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-48823419-d71c-4e18-952f-06db925daaaf tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:38.055498 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-48823419-d71c-4e18-952f-06db925daaaf tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:50:38.064693 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-48823419-d71c-4e18-952f-06db925daaaf tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1709 microversion: 2.1 time: 0.173975 Jun 24 09:50:38.065264 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 449/919] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:50:37 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1709 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:50:39.082398 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-bdb5fb08-3917-40fc-bcc7-355484bc4235 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:50:39.082990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-bdb5fb08-3917-40fc-bcc7-355484bc4235 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:50:39.092129 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bdb5fb08-3917-40fc-bcc7-355484bc4235 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:39.093165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bdb5fb08-3917-40fc-bcc7-355484bc4235 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:39.094018 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bdb5fb08-3917-40fc-bcc7-355484bc4235 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:50:39.094676 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-bdb5fb08-3917-40fc-bcc7-355484bc4235 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:50:39.239310 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-bdb5fb08-3917-40fc-bcc7-355484bc4235 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:50:39.247609 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-bdb5fb08-3917-40fc-bcc7-355484bc4235 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1713 microversion: 2.1 time: 0.169286 Jun 24 09:50:39.248186 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 471/920] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:50:39 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1713 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:11.891139 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-f26141f3-e2e7-4529-a682-79f344360534 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:11.891747 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-f26141f3-e2e7-4529-a682-79f344360534 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:11.894238 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=13 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:11.894894 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:11.900861 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f26141f3-e2e7-4529-a682-79f344360534 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:11.901294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f26141f3-e2e7-4529-a682-79f344360534 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:11.902067 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f26141f3-e2e7-4529-a682-79f344360534 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:11.902503 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f26141f3-e2e7-4529-a682-79f344360534 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:11.987943 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.objects.instance [None req-f26141f3-e2e7-4529-a682-79f344360534 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lazy-loading 'services' on Instance uuid a5447c85-6da6-43c6-932d-51bd5ddb6577 {{(pid=124338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:51:12.066360 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-f26141f3-e2e7-4529-a682-79f344360534 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577/os-volume_attachments/58b96884-e755-4c04-89ff-ed59311f7dba" status: 202 len: 0 microversion: 2.1 time: 0.179259 Jun 24 09:51:12.066963 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 450/921] 10.222.0.65 () {58 vars in 1415 bytes} [Fri Jun 24 09:51:11 2022] DELETE /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577/os-volume_attachments/58b96884-e755-4c04-89ff-ed59311f7dba => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:51:13.194093 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-78117298-8fe8-4c9d-9b47-a700169dcc40 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:51:13.196370 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=15 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:13.197039 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:13.204320 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-78117298-8fe8-4c9d-9b47-a700169dcc40 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:13.205010 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-78117298-8fe8-4c9d-9b47-a700169dcc40 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:13.233643 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-78117298-8fe8-4c9d-9b47-a700169dcc40 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Going to try to stop instance {{(pid=124339) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 24 09:51:13.292431 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-78117298-8fe8-4c9d-9b47-a700169dcc40 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "POST /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577/action" status: 202 len: 0 microversion: 2.1 time: 0.102195 Jun 24 09:51:13.293352 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 472/922] 10.222.0.65 () {60 vars in 1277 bytes} [Fri Jun 24 09:51:13 2022] POST /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:51:13.303506 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-85e1cc6f-fb8a-4b5b-aac7-93e487800dcd tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:13.304222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-85e1cc6f-fb8a-4b5b-aac7-93e487800dcd tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:13.310573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-85e1cc6f-fb8a-4b5b-aac7-93e487800dcd tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:13.311024 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-85e1cc6f-fb8a-4b5b-aac7-93e487800dcd tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:13.311831 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-85e1cc6f-fb8a-4b5b-aac7-93e487800dcd tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:13.312298 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-85e1cc6f-fb8a-4b5b-aac7-93e487800dcd tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:13.453047 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-85e1cc6f-fb8a-4b5b-aac7-93e487800dcd tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:13.461315 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-85e1cc6f-fb8a-4b5b-aac7-93e487800dcd tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1677 microversion: 2.1 time: 0.162371 Jun 24 09:51:13.461889 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 451/923] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:13 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:14.483410 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-0c69d95a-a7cd-4cb1-838a-60fa913b31d4 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:14.484156 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-0c69d95a-a7cd-4cb1-838a-60fa913b31d4 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:14.492464 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0c69d95a-a7cd-4cb1-838a-60fa913b31d4 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:14.492907 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0c69d95a-a7cd-4cb1-838a-60fa913b31d4 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:14.493672 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0c69d95a-a7cd-4cb1-838a-60fa913b31d4 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:14.494147 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-0c69d95a-a7cd-4cb1-838a-60fa913b31d4 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:14.644371 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-0c69d95a-a7cd-4cb1-838a-60fa913b31d4 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:14.656205 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-0c69d95a-a7cd-4cb1-838a-60fa913b31d4 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1677 microversion: 2.1 time: 0.178664 Jun 24 09:51:14.657041 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 473/924] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:14 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:15.674220 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-f479e7fc-eb7c-4ead-aeeb-65befb037c98 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:15.674887 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-f479e7fc-eb7c-4ead-aeeb-65befb037c98 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:15.682380 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f479e7fc-eb7c-4ead-aeeb-65befb037c98 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:15.682841 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f479e7fc-eb7c-4ead-aeeb-65befb037c98 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:15.683712 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f479e7fc-eb7c-4ead-aeeb-65befb037c98 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:15.684182 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-f479e7fc-eb7c-4ead-aeeb-65befb037c98 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:15.824462 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-f479e7fc-eb7c-4ead-aeeb-65befb037c98 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:15.832549 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-f479e7fc-eb7c-4ead-aeeb-65befb037c98 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1677 microversion: 2.1 time: 0.162465 Jun 24 09:51:15.833120 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 452/925] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:15 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:16.855128 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1bbd6204-2d3c-4250-8680-0703fe09b3cf tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:16.856155 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-1bbd6204-2d3c-4250-8680-0703fe09b3cf tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:16.867293 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1bbd6204-2d3c-4250-8680-0703fe09b3cf tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:16.868084 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1bbd6204-2d3c-4250-8680-0703fe09b3cf tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:16.869351 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1bbd6204-2d3c-4250-8680-0703fe09b3cf tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:16.870073 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1bbd6204-2d3c-4250-8680-0703fe09b3cf tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:17.010009 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-1bbd6204-2d3c-4250-8680-0703fe09b3cf tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:17.021964 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-1bbd6204-2d3c-4250-8680-0703fe09b3cf tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1677 microversion: 2.1 time: 0.173257 Jun 24 09:51:17.022702 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 474/926] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:16 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:18.041054 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-b3e3d024-c130-4140-bd44-343ed5184911 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:18.041679 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-b3e3d024-c130-4140-bd44-343ed5184911 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:18.048764 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b3e3d024-c130-4140-bd44-343ed5184911 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:18.049219 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b3e3d024-c130-4140-bd44-343ed5184911 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:18.049983 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b3e3d024-c130-4140-bd44-343ed5184911 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:18.050427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b3e3d024-c130-4140-bd44-343ed5184911 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:18.194854 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-b3e3d024-c130-4140-bd44-343ed5184911 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:18.206226 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-b3e3d024-c130-4140-bd44-343ed5184911 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1677 microversion: 2.1 time: 0.168901 Jun 24 09:51:18.206923 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 453/927] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:18 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:19.230386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-6c9d8961-9e4b-4177-be54-76bc51e08cc0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:19.231010 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-6c9d8961-9e4b-4177-be54-76bc51e08cc0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:19.239326 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6c9d8961-9e4b-4177-be54-76bc51e08cc0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:19.239786 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6c9d8961-9e4b-4177-be54-76bc51e08cc0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:19.240565 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6c9d8961-9e4b-4177-be54-76bc51e08cc0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:19.240998 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6c9d8961-9e4b-4177-be54-76bc51e08cc0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:19.381450 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6c9d8961-9e4b-4177-be54-76bc51e08cc0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:19.390222 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-6c9d8961-9e4b-4177-be54-76bc51e08cc0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1677 microversion: 2.1 time: 0.165623 Jun 24 09:51:19.391406 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 475/928] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:19 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:20.408592 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-3e43a72b-454b-4356-a794-ac46b8ee61e8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:20.409216 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-3e43a72b-454b-4356-a794-ac46b8ee61e8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:20.416107 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3e43a72b-454b-4356-a794-ac46b8ee61e8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:20.416553 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3e43a72b-454b-4356-a794-ac46b8ee61e8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:20.417323 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3e43a72b-454b-4356-a794-ac46b8ee61e8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:20.417755 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3e43a72b-454b-4356-a794-ac46b8ee61e8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:20.577325 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-3e43a72b-454b-4356-a794-ac46b8ee61e8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:20.586289 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-3e43a72b-454b-4356-a794-ac46b8ee61e8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1677 microversion: 2.1 time: 0.181687 Jun 24 09:51:20.587144 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 454/929] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:20 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:21.608176 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-835ab70b-5652-46fa-961d-472f6d82aef4 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:21.608778 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-835ab70b-5652-46fa-961d-472f6d82aef4 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:21.615357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-835ab70b-5652-46fa-961d-472f6d82aef4 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:21.615811 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-835ab70b-5652-46fa-961d-472f6d82aef4 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:21.616581 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-835ab70b-5652-46fa-961d-472f6d82aef4 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:21.617019 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-835ab70b-5652-46fa-961d-472f6d82aef4 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:21.764903 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-835ab70b-5652-46fa-961d-472f6d82aef4 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:21.774108 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-835ab70b-5652-46fa-961d-472f6d82aef4 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1677 microversion: 2.1 time: 0.171176 Jun 24 09:51:21.774692 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 476/930] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:21 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:22.800957 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ae1b1c43-36c0-443d-abe7-eb953174cb0b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:22.801830 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ae1b1c43-36c0-443d-abe7-eb953174cb0b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:22.810303 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ae1b1c43-36c0-443d-abe7-eb953174cb0b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:22.810752 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ae1b1c43-36c0-443d-abe7-eb953174cb0b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:22.811572 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ae1b1c43-36c0-443d-abe7-eb953174cb0b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:22.812027 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ae1b1c43-36c0-443d-abe7-eb953174cb0b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:22.955136 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ae1b1c43-36c0-443d-abe7-eb953174cb0b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:22.963589 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ae1b1c43-36c0-443d-abe7-eb953174cb0b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1677 microversion: 2.1 time: 0.170976 Jun 24 09:51:22.964442 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 455/931] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:22 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:23.073505 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-5126181a-3626-4cad-86fe-09d005be1327 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:23.074413 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-5126181a-3626-4cad-86fe-09d005be1327 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:23.084831 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5126181a-3626-4cad-86fe-09d005be1327 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:23.084831 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5126181a-3626-4cad-86fe-09d005be1327 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:23.085671 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5126181a-3626-4cad-86fe-09d005be1327 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:23.086286 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5126181a-3626-4cad-86fe-09d005be1327 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:23.119029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-5126181a-3626-4cad-86fe-09d005be1327 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Going to try to terminate instance {{(pid=124339) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:51:23.208991 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-5126181a-3626-4cad-86fe-09d005be1327 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 204 len: 0 microversion: 2.1 time: 0.141874 Jun 24 09:51:23.209594 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 477/932] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:51:23 2022] DELETE /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:51:23.219840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-dad524cc-b17e-47ba-9829-47d773721421 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:23.220900 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-dad524cc-b17e-47ba-9829-47d773721421 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:23.229755 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-dad524cc-b17e-47ba-9829-47d773721421 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:23.230516 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-dad524cc-b17e-47ba-9829-47d773721421 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:23.231539 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-dad524cc-b17e-47ba-9829-47d773721421 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:23.232440 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-dad524cc-b17e-47ba-9829-47d773721421 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:23.384310 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-dad524cc-b17e-47ba-9829-47d773721421 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:23.392927 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-dad524cc-b17e-47ba-9829-47d773721421 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 200 len: 1577 microversion: 2.1 time: 0.178514 Jun 24 09:51:23.393520 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 456/933] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:23 2022] GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:23.984232 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-6bade50c-8c21-4775-a133-9491f8f2a0c9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:23.985070 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-6bade50c-8c21-4775-a133-9491f8f2a0c9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:23.992306 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6bade50c-8c21-4775-a133-9491f8f2a0c9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:23.992843 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6bade50c-8c21-4775-a133-9491f8f2a0c9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:23.993845 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6bade50c-8c21-4775-a133-9491f8f2a0c9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:23.994288 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6bade50c-8c21-4775-a133-9491f8f2a0c9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:24.147891 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6bade50c-8c21-4775-a133-9491f8f2a0c9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:24.157683 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-6bade50c-8c21-4775-a133-9491f8f2a0c9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1677 microversion: 2.1 time: 0.178408 Jun 24 09:51:24.158327 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 478/934] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:23 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:24.413848 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-b2b5ff70-7ae5-40f0-a37f-984bd99e4529 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:24.414460 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-b2b5ff70-7ae5-40f0-a37f-984bd99e4529 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:24.423405 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b2b5ff70-7ae5-40f0-a37f-984bd99e4529 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:24.424164 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b2b5ff70-7ae5-40f0-a37f-984bd99e4529 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:24.426555 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b2b5ff70-7ae5-40f0-a37f-984bd99e4529 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:24.427265 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b2b5ff70-7ae5-40f0-a37f-984bd99e4529 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:24.578869 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-b2b5ff70-7ae5-40f0-a37f-984bd99e4529 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:24.587340 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-b2b5ff70-7ae5-40f0-a37f-984bd99e4529 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 200 len: 1577 microversion: 2.1 time: 0.177452 Jun 24 09:51:24.587917 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 457/935] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:24 2022] GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 1577 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:25.178556 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-ca854dc3-87b1-43dc-a8ed-9d6c0c13adbe tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:25.179329 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-ca854dc3-87b1-43dc-a8ed-9d6c0c13adbe tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:25.186714 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ca854dc3-87b1-43dc-a8ed-9d6c0c13adbe tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:25.187592 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ca854dc3-87b1-43dc-a8ed-9d6c0c13adbe tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:25.188298 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ca854dc3-87b1-43dc-a8ed-9d6c0c13adbe tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:25.188736 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ca854dc3-87b1-43dc-a8ed-9d6c0c13adbe tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:25.558725 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ca854dc3-87b1-43dc-a8ed-9d6c0c13adbe tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:25.566773 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-ca854dc3-87b1-43dc-a8ed-9d6c0c13adbe tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1654 microversion: 2.1 time: 0.392203 Jun 24 09:51:25.567530 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 479/936] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:25 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1654 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:25.585475 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-050c9235-7859-4df4-9b24-737e3bbcd176 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:51:25.592885 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-050c9235-7859-4df4-9b24-737e3bbcd176 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:25.593508 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-050c9235-7859-4df4-9b24-737e3bbcd176 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:25.606762 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-eaa3537b-ae61-492b-88b0-bc24e6e07f87 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:25.607513 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-eaa3537b-ae61-492b-88b0-bc24e6e07f87 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:25.613960 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eaa3537b-ae61-492b-88b0-bc24e6e07f87 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:25.614407 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eaa3537b-ae61-492b-88b0-bc24e6e07f87 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:25.615214 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eaa3537b-ae61-492b-88b0-bc24e6e07f87 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:25.615853 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-eaa3537b-ae61-492b-88b0-bc24e6e07f87 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:25.622493 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-050c9235-7859-4df4-9b24-737e3bbcd176 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Going to try to start instance {{(pid=124338) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 24 09:51:25.668902 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-050c9235-7859-4df4-9b24-737e3bbcd176 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "POST /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577/action" status: 202 len: 0 microversion: 2.1 time: 0.087808 Jun 24 09:51:25.669524 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 458/937] 10.222.0.65 () {60 vars in 1277 bytes} [Fri Jun 24 09:51:25 2022] POST /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:51:25.679896 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-6ddfbbdd-b4be-47a9-919e-ee73486867ac tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:25.680733 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-6ddfbbdd-b4be-47a9-919e-ee73486867ac tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:25.692812 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6ddfbbdd-b4be-47a9-919e-ee73486867ac tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:25.692812 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6ddfbbdd-b4be-47a9-919e-ee73486867ac tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:25.692812 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6ddfbbdd-b4be-47a9-919e-ee73486867ac tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:25.693270 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6ddfbbdd-b4be-47a9-919e-ee73486867ac tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:25.706089 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-eaa3537b-ae61-492b-88b0-bc24e6e07f87 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:25.716845 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-eaa3537b-ae61-492b-88b0-bc24e6e07f87 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 200 len: 1509 microversion: 2.1 time: 0.114232 Jun 24 09:51:25.717811 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 480/938] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:25 2022] GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 1509 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:26.019601 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-6ddfbbdd-b4be-47a9-919e-ee73486867ac tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:26.028610 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-6ddfbbdd-b4be-47a9-919e-ee73486867ac tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1663 microversion: 2.1 time: 0.354218 Jun 24 09:51:26.029187 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 459/939] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:25 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1663 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:51:26.357995 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-f80371ae-f634-45ac-a586-2fb8ba41956c req-d42aa1e3-36eb-4eed-9939-fc2286b46390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e6afd14-78c2-4765-b7ed-dfd75579caad", "name": "network-vif-deleted", "tag": "c5dfd2a6-c3d5-4903-bff2-2f159ad63caf"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:51:26.373935 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-f80371ae-f634-45ac-a586-2fb8ba41956c req-d42aa1e3-36eb-4eed-9939-fc2286b46390 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:26.376266 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-f80371ae-f634-45ac-a586-2fb8ba41956c req-d42aa1e3-36eb-4eed-9939-fc2286b46390 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:26.393914 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-f80371ae-f634-45ac-a586-2fb8ba41956c req-d42aa1e3-36eb-4eed-9939-fc2286b46390 service nova] Creating event network-vif-deleted:c5dfd2a6-c3d5-4903-bff2-2f159ad63caf for instance 4e6afd14-78c2-4765-b7ed-dfd75579caad on hv-cinder-80382 Jun 24 09:51:26.402252 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-f80371ae-f634-45ac-a586-2fb8ba41956c req-d42aa1e3-36eb-4eed-9939-fc2286b46390 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051380 Jun 24 09:51:26.403324 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 481/940] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:51:26.734768 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-a9127852-3da4-45e1-a801-a6f42e051a95 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:26.735415 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-a9127852-3da4-45e1-a801-a6f42e051a95 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:26.741545 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a9127852-3da4-45e1-a801-a6f42e051a95 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:26.741999 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a9127852-3da4-45e1-a801-a6f42e051a95 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:26.742785 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a9127852-3da4-45e1-a801-a6f42e051a95 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:26.743265 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a9127852-3da4-45e1-a801-a6f42e051a95 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:26.777006 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a9127852-3da4-45e1-a801-a6f42e051a95 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:26.777438 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a9127852-3da4-45e1-a801-a6f42e051a95 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:26.777882 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.objects.instance [None req-a9127852-3da4-45e1-a801-a6f42e051a95 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lazy-loading 'fault' on Instance uuid 4e6afd14-78c2-4765-b7ed-dfd75579caad {{(pid=124338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:51:26.831113 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-a9127852-3da4-45e1-a801-a6f42e051a95 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:26.839644 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-a9127852-3da4-45e1-a801-a6f42e051a95 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 200 len: 1229 microversion: 2.1 time: 0.109476 Jun 24 09:51:26.840237 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 460/941] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:26 2022] GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 1229 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:27.046934 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-9a8f8f90-0a1e-4a5a-aa60-498d372687e1 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:27.047652 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-9a8f8f90-0a1e-4a5a-aa60-498d372687e1 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:27.054375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9a8f8f90-0a1e-4a5a-aa60-498d372687e1 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:27.054800 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9a8f8f90-0a1e-4a5a-aa60-498d372687e1 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:27.055696 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9a8f8f90-0a1e-4a5a-aa60-498d372687e1 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:27.056093 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9a8f8f90-0a1e-4a5a-aa60-498d372687e1 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:27.204449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-9a8f8f90-0a1e-4a5a-aa60-498d372687e1 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:27.213088 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-9a8f8f90-0a1e-4a5a-aa60-498d372687e1 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1663 microversion: 2.1 time: 0.170760 Jun 24 09:51:27.213664 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 482/942] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:27 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1663 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:27.859230 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-21ad404b-72fc-4319-9c3f-1f35d1de318e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:27.859806 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-21ad404b-72fc-4319-9c3f-1f35d1de318e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:27.868526 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-21ad404b-72fc-4319-9c3f-1f35d1de318e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:27.869096 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-21ad404b-72fc-4319-9c3f-1f35d1de318e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:27.870021 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-21ad404b-72fc-4319-9c3f-1f35d1de318e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:27.870549 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-21ad404b-72fc-4319-9c3f-1f35d1de318e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:27.885638 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.wsgi [None req-21ad404b-72fc-4319-9c3f-1f35d1de318e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] HTTP exception thrown: Instance 4e6afd14-78c2-4765-b7ed-dfd75579caad could not be found. Jun 24 09:51:27.887347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-21ad404b-72fc-4319-9c3f-1f35d1de318e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Request method failure captured: Jun 24 09:51:27.887347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad HTTP/1.1 Jun 24 09:51:27.887347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:51:27.887347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:51:27.887347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:51:27.887347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 0 Jun 24 09:51:27.887347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:51:27.887347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:51:27.887347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:51:27.887347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:51:27.887347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYh2ob1GHCcN-weHeG-Yac33duC5pDLbhXA2lL77Lk21dmO84PU8CihYA67SrDmkkCMfDzOmxDcXAbwHthndPsqxUppcC7KgpE7NPhkI-XK7ZElQOwuH350qhFEkbh-AWvtFJ4cp9aoT05wS4VX4vOI6VNrtXiciEJM-jZ7ZA9vIzGM Jun 24 09:51:27.887347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:51:27.887347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:51:27.887347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:51:27.887347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:51:27.887347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:51:27.887347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:51:27.887347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: 86f042cb88b7426ea9733f70033b55e3 Jun 24 09:51:27.887347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-TestVolumeBootPattern-1317904589 Jun 24 09:51:27.887347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:51:27.887347 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:51:27.889229 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_86f042cb88b7426ea9733f70033b55e3", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/86f042cb88b7426ea9733f70033b55e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/86f042cb88b7426ea9733f70033b55e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/86f042cb88b7426ea9733f70033b55e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:51:27.889229 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-TestVolumeBootPattern-1317904589 Jun 24 09:51:27.889229 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: 86f042cb88b7426ea9733f70033b55e3 Jun 24 09:51:27.889229 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-TestVolumeBootPattern-1317904589 Jun 24 09:51:27.889229 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-TestVolumeBootPattern-1317904589-project Jun 24 09:51:27.889229 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:51:27.889229 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:51:27.889229 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: 565cc9705a94454b9e68595b85c6a286 Jun 24 09:51:27.889229 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-TestVolumeBootPattern-1317904589-project Jun 24 09:51:27.889229 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: > Jun 24 09:51:27.889229 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Instance 4e6afd14-78c2-4765-b7ed-dfd75579caad could not be found. Jun 24 09:51:27.889229 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'id': '4e6afd14-78c2-4765-b7ed-dfd75579caad'} Jun 24 09:51:27.890428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:51:27.890428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:51:27.890428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:51:27.890428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:51:27.890428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:51:27.890428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:51:27.890428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:51:27.890428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:51:27.890428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:51:27.890428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:51:27.890428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e6afd14-78c2-4765-b7ed-dfd75579caad could not be found. Jun 24 09:51:27.890428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:51:27.890428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:51:27.890428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:51:27.890428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:51:27.890428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:51:27.890428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:51:27.890428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:51:27.890428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:51:27.890428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:51:27.892433 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:51:27.892433 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:51:27.892433 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:51:27.892433 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:51:27.892433 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:51:27.892433 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:51:27.892433 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:51:27.892433 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e6afd14-78c2-4765-b7ed-dfd75579caad could not be found. Jun 24 09:51:27.892433 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:51:27.892433 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:51:27.892433 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:51:27.892433 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:51:27.892433 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:51:27.892433 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:51:27.892433 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:51:27.892433 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:51:27.892433 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e6afd14-78c2-4765-b7ed-dfd75579caad could not be found. Jun 24 09:51:27.892433 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:51:27.894176 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-21ad404b-72fc-4319-9c3f-1f35d1de318e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Returning 404 to user: Instance 4e6afd14-78c2-4765-b7ed-dfd75579caad could not be found. {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:51:27.894176 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-21ad404b-72fc-4319-9c3f-1f35d1de318e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 404 len: 111 microversion: 2.1 time: 0.034304 Jun 24 09:51:27.894176 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 461/943] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:27 2022] GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:51:27.996930 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-52a8d6ed-5bc2-4c3d-ab2f-79d0a017bbb7 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-504244789", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-853348123", "security_groups": [{"name": "tempest-secgroup-smoke-2012499460"}], "block_device_mapping_v2": [{"uuid": "7055e0ee-e0a5-49c4-9a2b-03ac06e4e199", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d67d849c-d27d-4bea-a085-4b945957c857"}]}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:51:28.114420 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.network.neutron [None req-52a8d6ed-5bc2-4c3d-ab2f-79d0a017bbb7 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] validate_networks() for [('d67d849c-d27d-4bea-a085-4b945957c857', None, None, None, None, None)] {{(pid=124339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:51:28.232461 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-933f4ab7-dcfa-4af4-907d-be70b7ddb347 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:28.233101 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-933f4ab7-dcfa-4af4-907d-be70b7ddb347 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:28.239867 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-933f4ab7-dcfa-4af4-907d-be70b7ddb347 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:28.240318 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-933f4ab7-dcfa-4af4-907d-be70b7ddb347 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:28.241100 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-933f4ab7-dcfa-4af4-907d-be70b7ddb347 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:28.241529 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-933f4ab7-dcfa-4af4-907d-be70b7ddb347 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:28.454923 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-933f4ab7-dcfa-4af4-907d-be70b7ddb347 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:28.465337 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-933f4ab7-dcfa-4af4-907d-be70b7ddb347 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1667 microversion: 2.1 time: 0.236630 Jun 24 09:51:28.466207 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 462/944] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:28 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1667 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:28.581992 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-52a8d6ed-5bc2-4c3d-ab2f-79d0a017bbb7 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Flavor limits 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:51:28.582700 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-52a8d6ed-5bc2-4c3d-ab2f-79d0a017bbb7 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Image limits 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:51:28.583543 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-52a8d6ed-5bc2-4c3d-ab2f-79d0a017bbb7 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Flavor pref 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:51:28.584203 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-52a8d6ed-5bc2-4c3d-ab2f-79d0a017bbb7 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Image pref 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:51:28.585151 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-52a8d6ed-5bc2-4c3d-ab2f-79d0a017bbb7 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:51:28.596781 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-52a8d6ed-5bc2-4c3d-ab2f-79d0a017bbb7 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:28.597149 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-52a8d6ed-5bc2-4c3d-ab2f-79d0a017bbb7 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:28.597946 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-52a8d6ed-5bc2-4c3d-ab2f-79d0a017bbb7 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:28.598387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-52a8d6ed-5bc2-4c3d-ab2f-79d0a017bbb7 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:28.615857 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-52a8d6ed-5bc2-4c3d-ab2f-79d0a017bbb7 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Getting quotas for project 86f042cb88b7426ea9733f70033b55e3. Resources: {'cores', 'ram', 'instances'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:51:28.619947 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-52a8d6ed-5bc2-4c3d-ab2f-79d0a017bbb7 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Getting quotas for user 565cc9705a94454b9e68595b85c6a286 and project 86f042cb88b7426ea9733f70033b55e3. Resources: {'cores', 'ram', 'instances'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:51:28.681193 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-52a8d6ed-5bc2-4c3d-ab2f-79d0a017bbb7 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Going to run 1 instances... {{(pid=124339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:51:28.683538 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-52a8d6ed-5bc2-4c3d-ab2f-79d0a017bbb7 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: f2590ea8-3eb7-4a3e-ad98-75df30f2c860] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7055e0ee-e0a5-49c4-9a2b-03ac06e4e199',volume_size=None,volume_type=None)] {{(pid=124339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:51:28.841287 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-52a8d6ed-5bc2-4c3d-ab2f-79d0a017bbb7 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.848225 Jun 24 09:51:28.841892 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 483/945] 10.222.0.65 () {60 vars in 1146 bytes} [Fri Jun 24 09:51:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 09:51:28.853938 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-4aa240c2-a3dc-4068-9b3c-873eedd51f16 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:28.854687 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-4aa240c2-a3dc-4068-9b3c-873eedd51f16 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: f2590ea8-3eb7-4a3e-ad98-75df30f2c860] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:28.913247 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-4aa240c2-a3dc-4068-9b3c-873eedd51f16 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:28.919957 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-4aa240c2-a3dc-4068-9b3c-873eedd51f16 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860" status: 200 len: 1093 microversion: 2.1 time: 0.070955 Jun 24 09:51:28.920595 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 463/946] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:28 2022] GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:29.938399 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3d310778-de2f-482a-ad92-99f4c467e81e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:29.939177 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3d310778-de2f-482a-ad92-99f4c467e81e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: f2590ea8-3eb7-4a3e-ad98-75df30f2c860] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:29.946131 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3d310778-de2f-482a-ad92-99f4c467e81e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:29.946579 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3d310778-de2f-482a-ad92-99f4c467e81e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:29.948421 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3d310778-de2f-482a-ad92-99f4c467e81e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:29.948421 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3d310778-de2f-482a-ad92-99f4c467e81e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:30.028455 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3d310778-de2f-482a-ad92-99f4c467e81e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:30.037005 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3d310778-de2f-482a-ad92-99f4c467e81e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860" status: 200 len: 1209 microversion: 2.1 time: 0.103527 Jun 24 09:51:30.037748 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 484/947] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:29 2022] GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860 => generated 1209 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:31.060288 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-6249347f-bbf0-43e7-ba07-f6e2fe14109d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:31.061000 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-6249347f-bbf0-43e7-ba07-f6e2fe14109d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: f2590ea8-3eb7-4a3e-ad98-75df30f2c860] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:31.070450 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6249347f-bbf0-43e7-ba07-f6e2fe14109d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:31.070901 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6249347f-bbf0-43e7-ba07-f6e2fe14109d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:31.071710 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6249347f-bbf0-43e7-ba07-f6e2fe14109d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:31.072148 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6249347f-bbf0-43e7-ba07-f6e2fe14109d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:31.292398 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-6249347f-bbf0-43e7-ba07-f6e2fe14109d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:31.300580 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-6249347f-bbf0-43e7-ba07-f6e2fe14109d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860" status: 200 len: 1265 microversion: 2.1 time: 0.244118 Jun 24 09:51:31.301176 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 464/948] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:31 2022] GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:31.404847 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-cc063359-02f0-4eaa-b185-e8f9fce49444 req-685cba44-57ac-45af-a88d-2c0c1a26f8a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2590ea8-3eb7-4a3e-ad98-75df30f2c860", "tag": "25bf3243-4587-41bb-aca6-0b4879099ded"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:51:31.418234 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-cc063359-02f0-4eaa-b185-e8f9fce49444 req-685cba44-57ac-45af-a88d-2c0c1a26f8a7 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:31.422146 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-cc063359-02f0-4eaa-b185-e8f9fce49444 req-685cba44-57ac-45af-a88d-2c0c1a26f8a7 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:31.439353 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-cc063359-02f0-4eaa-b185-e8f9fce49444 req-685cba44-57ac-45af-a88d-2c0c1a26f8a7 service nova] Creating event network-changed:25bf3243-4587-41bb-aca6-0b4879099ded for instance f2590ea8-3eb7-4a3e-ad98-75df30f2c860 on hv-cinder-80382 Jun 24 09:51:31.445171 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-cc063359-02f0-4eaa-b185-e8f9fce49444 req-685cba44-57ac-45af-a88d-2c0c1a26f8a7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046517 Jun 24 09:51:31.446366 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 485/949] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:51:32.317979 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-770c88fc-f429-4b3e-ab49-6d6bb98f2e13 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:32.318586 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-770c88fc-f429-4b3e-ab49-6d6bb98f2e13 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: f2590ea8-3eb7-4a3e-ad98-75df30f2c860] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:32.325423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-770c88fc-f429-4b3e-ab49-6d6bb98f2e13 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:32.325792 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-770c88fc-f429-4b3e-ab49-6d6bb98f2e13 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:32.326604 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-770c88fc-f429-4b3e-ab49-6d6bb98f2e13 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:32.327041 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-770c88fc-f429-4b3e-ab49-6d6bb98f2e13 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:32.554696 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-770c88fc-f429-4b3e-ab49-6d6bb98f2e13 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:32.563558 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-770c88fc-f429-4b3e-ab49-6d6bb98f2e13 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860" status: 200 len: 1265 microversion: 2.1 time: 0.249430 Jun 24 09:51:32.564180 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 465/950] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:32 2022] GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860 => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:33.582090 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-97e9de48-29b8-4633-98d1-c48fe6ec45ef tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:33.582778 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-97e9de48-29b8-4633-98d1-c48fe6ec45ef tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: f2590ea8-3eb7-4a3e-ad98-75df30f2c860] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:33.589946 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-97e9de48-29b8-4633-98d1-c48fe6ec45ef tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:33.590398 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-97e9de48-29b8-4633-98d1-c48fe6ec45ef tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:33.591300 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-97e9de48-29b8-4633-98d1-c48fe6ec45ef tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:33.591741 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-97e9de48-29b8-4633-98d1-c48fe6ec45ef tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:33.724302 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-97e9de48-29b8-4633-98d1-c48fe6ec45ef tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:33.732373 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-97e9de48-29b8-4633-98d1-c48fe6ec45ef tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860" status: 200 len: 1265 microversion: 2.1 time: 0.155241 Jun 24 09:51:33.732823 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 486/951] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:33 2022] GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:34.750999 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-693720a9-8b49-47bc-81e0-902f37e96954 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:34.751646 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-693720a9-8b49-47bc-81e0-902f37e96954 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: f2590ea8-3eb7-4a3e-ad98-75df30f2c860] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:34.758682 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-693720a9-8b49-47bc-81e0-902f37e96954 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:34.759321 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-693720a9-8b49-47bc-81e0-902f37e96954 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:34.760111 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-693720a9-8b49-47bc-81e0-902f37e96954 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:34.760552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-693720a9-8b49-47bc-81e0-902f37e96954 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:34.765021 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:34.904900 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-693720a9-8b49-47bc-81e0-902f37e96954 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:34.913154 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-693720a9-8b49-47bc-81e0-902f37e96954 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860" status: 200 len: 1265 microversion: 2.1 time: 0.166137 Jun 24 09:51:34.913741 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 466/952] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:34 2022] GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:35.930199 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4d3803c4-078d-4afb-a973-65c6d2828d32 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:35.930816 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-4d3803c4-078d-4afb-a973-65c6d2828d32 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: f2590ea8-3eb7-4a3e-ad98-75df30f2c860] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:35.937926 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4d3803c4-078d-4afb-a973-65c6d2828d32 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:35.938357 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4d3803c4-078d-4afb-a973-65c6d2828d32 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:35.939183 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4d3803c4-078d-4afb-a973-65c6d2828d32 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:35.939622 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4d3803c4-078d-4afb-a973-65c6d2828d32 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:36.074040 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4d3803c4-078d-4afb-a973-65c6d2828d32 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:36.079574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:36.087186 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-4d3803c4-078d-4afb-a973-65c6d2828d32 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860" status: 200 len: 1265 microversion: 2.1 time: 0.160733 Jun 24 09:51:36.088169 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 487/953] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:35 2022] GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:37.104425 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-0cf92488-2a29-4feb-96fd-c70831d1cede tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:37.104997 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-0cf92488-2a29-4feb-96fd-c70831d1cede tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: f2590ea8-3eb7-4a3e-ad98-75df30f2c860] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:37.112316 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0cf92488-2a29-4feb-96fd-c70831d1cede tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:37.112763 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0cf92488-2a29-4feb-96fd-c70831d1cede tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:37.113526 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0cf92488-2a29-4feb-96fd-c70831d1cede tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:37.113954 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-0cf92488-2a29-4feb-96fd-c70831d1cede tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:37.262232 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-0cf92488-2a29-4feb-96fd-c70831d1cede tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:37.271835 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-0cf92488-2a29-4feb-96fd-c70831d1cede tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860" status: 200 len: 1265 microversion: 2.1 time: 0.171453 Jun 24 09:51:37.272415 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 467/954] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:37 2022] GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:38.289806 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-385a00d7-a604-43ea-bfa8-0e1f8da06827 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:38.290415 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-385a00d7-a604-43ea-bfa8-0e1f8da06827 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: f2590ea8-3eb7-4a3e-ad98-75df30f2c860] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:38.297581 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-385a00d7-a604-43ea-bfa8-0e1f8da06827 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:38.298024 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-385a00d7-a604-43ea-bfa8-0e1f8da06827 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:38.298963 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-385a00d7-a604-43ea-bfa8-0e1f8da06827 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:38.299489 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-385a00d7-a604-43ea-bfa8-0e1f8da06827 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:38.438915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-385a00d7-a604-43ea-bfa8-0e1f8da06827 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:38.453602 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-385a00d7-a604-43ea-bfa8-0e1f8da06827 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860" status: 200 len: 1265 microversion: 2.1 time: 0.167745 Jun 24 09:51:38.454695 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 488/955] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:38 2022] GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:39.482636 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-3d0e3aa2-1c8f-42f6-99b4-02e4f1d2c310 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:39.483285 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-3d0e3aa2-1c8f-42f6-99b4-02e4f1d2c310 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: f2590ea8-3eb7-4a3e-ad98-75df30f2c860] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:39.486702 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=2 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:39.492796 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3d0e3aa2-1c8f-42f6-99b4-02e4f1d2c310 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:39.493858 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3d0e3aa2-1c8f-42f6-99b4-02e4f1d2c310 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:39.494019 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3d0e3aa2-1c8f-42f6-99b4-02e4f1d2c310 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:39.494452 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-3d0e3aa2-1c8f-42f6-99b4-02e4f1d2c310 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:39.650664 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-3d0e3aa2-1c8f-42f6-99b4-02e4f1d2c310 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:39.659585 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-3d0e3aa2-1c8f-42f6-99b4-02e4f1d2c310 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860" status: 200 len: 1265 microversion: 2.1 time: 0.183016 Jun 24 09:51:39.660160 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 468/956] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:39 2022] GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:40.683493 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c73d4a39-fc4e-4f19-bf65-b7508f6bdfc9 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:40.684658 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-c73d4a39-fc4e-4f19-bf65-b7508f6bdfc9 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: f2590ea8-3eb7-4a3e-ad98-75df30f2c860] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:40.687635 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=2 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:40.688773 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=6 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:40.697668 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c73d4a39-fc4e-4f19-bf65-b7508f6bdfc9 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:40.698115 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c73d4a39-fc4e-4f19-bf65-b7508f6bdfc9 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:40.699099 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c73d4a39-fc4e-4f19-bf65-b7508f6bdfc9 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:40.699552 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c73d4a39-fc4e-4f19-bf65-b7508f6bdfc9 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:40.841931 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c73d4a39-fc4e-4f19-bf65-b7508f6bdfc9 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:40.850035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-c73d4a39-fc4e-4f19-bf65-b7508f6bdfc9 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860" status: 200 len: 1265 microversion: 2.1 time: 0.174391 Jun 24 09:51:40.850823 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 489/957] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:40 2022] GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:41.871308 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-427ac611-26f4-49d2-bd4a-81754530b138 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:41.871308 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-427ac611-26f4-49d2-bd4a-81754530b138 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: f2590ea8-3eb7-4a3e-ad98-75df30f2c860] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:41.879515 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-427ac611-26f4-49d2-bd4a-81754530b138 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:41.880079 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-427ac611-26f4-49d2-bd4a-81754530b138 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:41.881746 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-427ac611-26f4-49d2-bd4a-81754530b138 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:41.882353 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-427ac611-26f4-49d2-bd4a-81754530b138 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:42.022264 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-427ac611-26f4-49d2-bd4a-81754530b138 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:42.030412 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-427ac611-26f4-49d2-bd4a-81754530b138 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860" status: 200 len: 1265 microversion: 2.1 time: 0.165953 Jun 24 09:51:42.030994 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 469/958] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:41 2022] GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:42.426334 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-f00896d4-1a05-4636-8038-4b62905caf3d req-d2c0e13b-85cc-486f-955c-350c362d77a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2590ea8-3eb7-4a3e-ad98-75df30f2c860", "name": "network-vif-plugged", "status": "completed", "tag": "25bf3243-4587-41bb-aca6-0b4879099ded"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:51:42.436866 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-f00896d4-1a05-4636-8038-4b62905caf3d req-d2c0e13b-85cc-486f-955c-350c362d77a3 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:42.437269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-f00896d4-1a05-4636-8038-4b62905caf3d req-d2c0e13b-85cc-486f-955c-350c362d77a3 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:42.448858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-f00896d4-1a05-4636-8038-4b62905caf3d req-d2c0e13b-85cc-486f-955c-350c362d77a3 service nova] Creating event network-vif-plugged:25bf3243-4587-41bb-aca6-0b4879099ded for instance f2590ea8-3eb7-4a3e-ad98-75df30f2c860 on hv-cinder-80382 Jun 24 09:51:42.453827 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-f00896d4-1a05-4636-8038-4b62905caf3d req-d2c0e13b-85cc-486f-955c-350c362d77a3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032043 Jun 24 09:51:42.454410 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 490/959] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:51:43.048573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-fc2be46d-fbe7-4d2a-9b7a-a4629a853a4f tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:43.049295 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-fc2be46d-fbe7-4d2a-9b7a-a4629a853a4f tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: f2590ea8-3eb7-4a3e-ad98-75df30f2c860] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:43.052131 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=45 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:43.058900 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fc2be46d-fbe7-4d2a-9b7a-a4629a853a4f tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:43.059371 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fc2be46d-fbe7-4d2a-9b7a-a4629a853a4f tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:43.060167 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fc2be46d-fbe7-4d2a-9b7a-a4629a853a4f tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:43.060596 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fc2be46d-fbe7-4d2a-9b7a-a4629a853a4f tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:43.206054 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-fc2be46d-fbe7-4d2a-9b7a-a4629a853a4f tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:43.214755 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-fc2be46d-fbe7-4d2a-9b7a-a4629a853a4f tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860" status: 200 len: 1265 microversion: 2.1 time: 0.170112 Jun 24 09:51:43.215452 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 470/960] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:43 2022] GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:44.234097 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-2ee5d46f-477d-4697-9c9d-ee5fa764e066 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:44.234775 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-2ee5d46f-477d-4697-9c9d-ee5fa764e066 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: f2590ea8-3eb7-4a3e-ad98-75df30f2c860] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:44.237158 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:44.244143 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2ee5d46f-477d-4697-9c9d-ee5fa764e066 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:44.244663 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2ee5d46f-477d-4697-9c9d-ee5fa764e066 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:44.245706 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2ee5d46f-477d-4697-9c9d-ee5fa764e066 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:44.246258 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2ee5d46f-477d-4697-9c9d-ee5fa764e066 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:44.400241 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-2ee5d46f-477d-4697-9c9d-ee5fa764e066 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:44.408539 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-2ee5d46f-477d-4697-9c9d-ee5fa764e066 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860" status: 200 len: 1265 microversion: 2.1 time: 0.179976 Jun 24 09:51:44.409133 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 491/961] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:44 2022] GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:45.426305 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-572dc6c4-5768-4fd5-8952-2211b27459e1 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:45.426921 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-572dc6c4-5768-4fd5-8952-2211b27459e1 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: f2590ea8-3eb7-4a3e-ad98-75df30f2c860] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:45.433690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-572dc6c4-5768-4fd5-8952-2211b27459e1 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:45.434116 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-572dc6c4-5768-4fd5-8952-2211b27459e1 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:45.434887 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-572dc6c4-5768-4fd5-8952-2211b27459e1 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:45.435359 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-572dc6c4-5768-4fd5-8952-2211b27459e1 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:45.571242 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-572dc6c4-5768-4fd5-8952-2211b27459e1 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:45.579554 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-572dc6c4-5768-4fd5-8952-2211b27459e1 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860" status: 200 len: 1453 microversion: 2.1 time: 0.157316 Jun 24 09:51:45.580112 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 471/962] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:45 2022] GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:45.596285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f6ba6a4e-cd2a-43ff-9297-eb834938576d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:51:45.596901 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-f6ba6a4e-cd2a-43ff-9297-eb834938576d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: f2590ea8-3eb7-4a3e-ad98-75df30f2c860] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:51:45.603850 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f6ba6a4e-cd2a-43ff-9297-eb834938576d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:45.604296 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f6ba6a4e-cd2a-43ff-9297-eb834938576d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:45.605093 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f6ba6a4e-cd2a-43ff-9297-eb834938576d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:45.605553 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f6ba6a4e-cd2a-43ff-9297-eb834938576d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:45.751460 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-f6ba6a4e-cd2a-43ff-9297-eb834938576d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:51:45.759562 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f6ba6a4e-cd2a-43ff-9297-eb834938576d tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860" status: 200 len: 1453 microversion: 2.1 time: 0.166979 Jun 24 09:51:45.760132 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 492/963] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:51:45 2022] GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860 => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:51:47.514554 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-ff8db264-0efb-4792-91c6-6c190fa344f3 req-c4cebdbf-912e-422c-9098-3faffb20a5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2590ea8-3eb7-4a3e-ad98-75df30f2c860", "tag": "25bf3243-4587-41bb-aca6-0b4879099ded"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:51:47.523613 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-ff8db264-0efb-4792-91c6-6c190fa344f3 req-c4cebdbf-912e-422c-9098-3faffb20a5d6 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:51:47.524078 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-ff8db264-0efb-4792-91c6-6c190fa344f3 req-c4cebdbf-912e-422c-9098-3faffb20a5d6 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:51:47.536643 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-ff8db264-0efb-4792-91c6-6c190fa344f3 req-c4cebdbf-912e-422c-9098-3faffb20a5d6 service nova] Creating event network-changed:25bf3243-4587-41bb-aca6-0b4879099ded for instance f2590ea8-3eb7-4a3e-ad98-75df30f2c860 on hv-cinder-80382 Jun 24 09:51:47.542655 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-ff8db264-0efb-4792-91c6-6c190fa344f3 req-c4cebdbf-912e-422c-9098-3faffb20a5d6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032411 Jun 24 09:51:47.543712 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 472/964] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:51:57.324882 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:51:57.325672 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Fri Jun 24 09:51:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:52:00.812231 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=3 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:00.812983 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=26 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:00.817018 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-9512bedc-5286-4ef2-a7bf-8e502a7af20b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:00.818013 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-9512bedc-5286-4ef2-a7bf-8e502a7af20b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:00.825660 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9512bedc-5286-4ef2-a7bf-8e502a7af20b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:00.826138 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9512bedc-5286-4ef2-a7bf-8e502a7af20b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:00.826914 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9512bedc-5286-4ef2-a7bf-8e502a7af20b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:00.827388 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9512bedc-5286-4ef2-a7bf-8e502a7af20b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:00.859607 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-9512bedc-5286-4ef2-a7bf-8e502a7af20b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048424 Jun 24 09:52:00.860172 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 493/965] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:52:00 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 09:52:00.923860 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-e306129f-cd74-49f6-84a4-281962203ac8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:00.924423 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-e306129f-cd74-49f6-84a4-281962203ac8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:00.926924 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=5 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:00.927722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=36 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:00.936091 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e306129f-cd74-49f6-84a4-281962203ac8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:00.936542 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e306129f-cd74-49f6-84a4-281962203ac8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:00.937322 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e306129f-cd74-49f6-84a4-281962203ac8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:00.937747 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e306129f-cd74-49f6-84a4-281962203ac8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:00.963548 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-e306129f-cd74-49f6-84a4-281962203ac8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Going to try to terminate instance {{(pid=124338) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:52:01.043064 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-e306129f-cd74-49f6-84a4-281962203ac8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 204 len: 0 microversion: 2.1 time: 0.123720 Jun 24 09:52:01.043900 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 473/966] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:52:00 2022] DELETE /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:52:01.052704 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c398ee00-5f36-460b-97c5-a548d5394059 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:01.053321 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-c398ee00-5f36-460b-97c5-a548d5394059 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:01.059677 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c398ee00-5f36-460b-97c5-a548d5394059 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:01.060138 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c398ee00-5f36-460b-97c5-a548d5394059 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:01.060940 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c398ee00-5f36-460b-97c5-a548d5394059 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:01.061382 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c398ee00-5f36-460b-97c5-a548d5394059 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:01.258704 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c398ee00-5f36-460b-97c5-a548d5394059 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:01.267314 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-c398ee00-5f36-460b-97c5-a548d5394059 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1673 microversion: 2.1 time: 0.218765 Jun 24 09:52:01.267923 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 494/967] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:01 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1673 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:52:02.287856 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-16eeaa69-a298-4417-a927-7f5c6cdad31e tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:02.288613 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-16eeaa69-a298-4417-a927-7f5c6cdad31e tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:02.296549 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-16eeaa69-a298-4417-a927-7f5c6cdad31e tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:02.296999 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-16eeaa69-a298-4417-a927-7f5c6cdad31e tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:02.297772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-16eeaa69-a298-4417-a927-7f5c6cdad31e tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:02.298201 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-16eeaa69-a298-4417-a927-7f5c6cdad31e tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:02.490441 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-16eeaa69-a298-4417-a927-7f5c6cdad31e tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:02.498719 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-16eeaa69-a298-4417-a927-7f5c6cdad31e tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1673 microversion: 2.1 time: 0.216584 Jun 24 09:52:02.499292 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 474/968] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:02 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1673 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:03.516841 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-e47e9ad5-ef90-4daa-af24-de0739028729 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:03.517481 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-e47e9ad5-ef90-4daa-af24-de0739028729 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:03.524111 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e47e9ad5-ef90-4daa-af24-de0739028729 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:03.524555 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e47e9ad5-ef90-4daa-af24-de0739028729 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:03.525316 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e47e9ad5-ef90-4daa-af24-de0739028729 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:03.525745 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-e47e9ad5-ef90-4daa-af24-de0739028729 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:03.616204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-e47e9ad5-ef90-4daa-af24-de0739028729 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:03.641682 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-e47e9ad5-ef90-4daa-af24-de0739028729 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 200 len: 1606 microversion: 2.1 time: 0.129402 Jun 24 09:52:03.642294 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 495/969] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:03 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 1606 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:04.173650 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-1bed6362-676b-4925-9c0e-ff557645bc97 req-e6216a51-6b9d-488c-b4da-49e07a6b13be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5447c85-6da6-43c6-932d-51bd5ddb6577", "name": "network-vif-deleted", "tag": "6ccc9a50-deba-4fe7-9a3d-7559860e9eb5"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:52:04.183609 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-1bed6362-676b-4925-9c0e-ff557645bc97 req-e6216a51-6b9d-488c-b4da-49e07a6b13be service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:04.190288 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-1bed6362-676b-4925-9c0e-ff557645bc97 req-e6216a51-6b9d-488c-b4da-49e07a6b13be service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:04.203371 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-1bed6362-676b-4925-9c0e-ff557645bc97 req-e6216a51-6b9d-488c-b4da-49e07a6b13be service nova] Creating event network-vif-deleted:6ccc9a50-deba-4fe7-9a3d-7559860e9eb5 for instance a5447c85-6da6-43c6-932d-51bd5ddb6577 on hv-cinder-80382 Jun 24 09:52:04.208935 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-1bed6362-676b-4925-9c0e-ff557645bc97 req-e6216a51-6b9d-488c-b4da-49e07a6b13be service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038775 Jun 24 09:52:04.209537 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 475/970] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:52:04.663940 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1c01cb84-1bf7-4ec5-a32f-568c8d55fd1f tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:04.665092 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-1c01cb84-1bf7-4ec5-a32f-568c8d55fd1f tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:04.673876 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1c01cb84-1bf7-4ec5-a32f-568c8d55fd1f tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:04.674406 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1c01cb84-1bf7-4ec5-a32f-568c8d55fd1f tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:04.675323 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1c01cb84-1bf7-4ec5-a32f-568c8d55fd1f tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:04.675877 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-1c01cb84-1bf7-4ec5-a32f-568c8d55fd1f tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:04.691472 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-1c01cb84-1bf7-4ec5-a32f-568c8d55fd1f tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] HTTP exception thrown: Instance a5447c85-6da6-43c6-932d-51bd5ddb6577 could not be found. Jun 24 09:52:04.693449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1c01cb84-1bf7-4ec5-a32f-568c8d55fd1f tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Request method failure captured: Jun 24 09:52:04.693449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 HTTP/1.1 Jun 24 09:52:04.693449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:52:04.693449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:52:04.693449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:52:04.693449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:52:04.693449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:52:04.693449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:52:04.693449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:52:04.693449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:52:04.693449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYigaj_ai9ZCtd1IPsoyIM3aZwQaxq_4zYiPV5tiqrQNTUM5jL0zuvOJJLIhUAQLcrT5lyoJRR5piqJAjuzLoOzIsIr3uBUYgSYViJydaauzIBIWF16GWl67WSJymfv6AIx8C8SLIqEP3guZY0k7DnhjHMsFMBH31MDp_90KswhzexE Jun 24 09:52:04.693449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:52:04.693449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:52:04.693449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:52:04.693449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:52:04.693449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:52:04.693449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:52:04.693449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 9c90246f01ad410ea9569c51eb5f2ecb Jun 24 09:52:04.693449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-AttachVolumeTestJSON-681977095 Jun 24 09:52:04.693449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:52:04.693449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:52:04.695698 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9c90246f01ad410ea9569c51eb5f2ecb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9c90246f01ad410ea9569c51eb5f2ecb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9c90246f01ad410ea9569c51eb5f2ecb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9c90246f01ad410ea9569c51eb5f2ecb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:52:04.695698 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-AttachVolumeTestJSON-681977095 Jun 24 09:52:04.695698 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 9c90246f01ad410ea9569c51eb5f2ecb Jun 24 09:52:04.695698 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-AttachVolumeTestJSON-681977095 Jun 24 09:52:04.695698 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-AttachVolumeTestJSON-681977095-project Jun 24 09:52:04.695698 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:52:04.695698 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:52:04.695698 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: 3477f21462c84759b0762cf13427b3c8 Jun 24 09:52:04.695698 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-AttachVolumeTestJSON-681977095-project Jun 24 09:52:04.695698 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:52:04.695698 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance a5447c85-6da6-43c6-932d-51bd5ddb6577 could not be found. Jun 24 09:52:04.695698 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': 'a5447c85-6da6-43c6-932d-51bd5ddb6577'} Jun 24 09:52:04.696724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:52:04.696724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:52:04.696724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:52:04.696724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:52:04.696724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:52:04.696724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:52:04.696724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:52:04.696724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:52:04.696724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:52:04.696724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:52:04.696724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5447c85-6da6-43c6-932d-51bd5ddb6577 could not be found. Jun 24 09:52:04.696724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:52:04.696724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:52:04.696724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:52:04.696724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:52:04.696724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:52:04.696724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:52:04.696724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:52:04.696724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:52:04.696724 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:52:04.698269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:52:04.698269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:52:04.698269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:52:04.698269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:52:04.698269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:52:04.698269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:52:04.698269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:52:04.698269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5447c85-6da6-43c6-932d-51bd5ddb6577 could not be found. Jun 24 09:52:04.698269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:52:04.698269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:52:04.698269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:52:04.698269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:52:04.698269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:52:04.698269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:52:04.698269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:52:04.698269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:52:04.698269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5447c85-6da6-43c6-932d-51bd5ddb6577 could not be found. Jun 24 09:52:04.698269 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:52:04.699699 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1c01cb84-1bf7-4ec5-a32f-568c8d55fd1f tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Returning 404 to user: Instance a5447c85-6da6-43c6-932d-51bd5ddb6577 could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:52:04.699699 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-1c01cb84-1bf7-4ec5-a32f-568c8d55fd1f tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 404 len: 111 microversion: 2.1 time: 0.038279 Jun 24 09:52:04.699699 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 496/971] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:04 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:52:04.706862 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-5787ee61-f5cd-4704-a410-9774de37defa tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '.version_select at 0x7fc6d4c0f160>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:04.727865 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-5787ee61-f5cd-4704-a410-9774de37defa tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1341101253" status: 202 len: 0 microversion: 2.1 time: 0.025680 Jun 24 09:52:04.728443 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 476/972] 10.222.0.65 () {58 vars in 1220 bytes} [Fri Jun 24 09:52:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1341101253 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:52:05.380671 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-0ecb1415-80af-4055-9399-04876eb9ff0a tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Action: 'create', calling method: .version_select at 0x7fc6d449e280>, body: {"keypair": {"name": "tempest-keypair-935810863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/OWZdAgb7odJUHeZSf5N4Mhe3Am8bPNjOwRoYZJb1PHivnQUk+Ksz8PD+5e+rsBmtMXDxnmF+XIvMIEGuoW88Wvp1tOV9J1LGXTsWpDemO52s/awST5x7UY+3vuOBmtg=="}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:52:05.395482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-0ecb1415-80af-4055-9399-04876eb9ff0a tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Getting quotas for project 9c90246f01ad410ea9569c51eb5f2ecb. Resources: {'key_pairs'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:52:05.399680 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-0ecb1415-80af-4055-9399-04876eb9ff0a tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Getting quotas for user 3477f21462c84759b0762cf13427b3c8 and project 9c90246f01ad410ea9569c51eb5f2ecb. Resources: {'key_pairs'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:52:05.423677 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-0ecb1415-80af-4055-9399-04876eb9ff0a tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046981 Jun 24 09:52:05.424277 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 497/973] 10.222.0.65 () {60 vars in 1158 bytes} [Fri Jun 24 09:52:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:52:06.766871 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-6ec5c95c-951d-4c37-b1e6-3c1e6dfc35f0 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:52:06.767587 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-6ec5c95c-951d-4c37-b1e6-3c1e6dfc35f0 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:06.773848 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6ec5c95c-951d-4c37-b1e6-3c1e6dfc35f0 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:06.774296 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6ec5c95c-951d-4c37-b1e6-3c1e6dfc35f0 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:06.775045 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6ec5c95c-951d-4c37-b1e6-3c1e6dfc35f0 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:06.775521 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6ec5c95c-951d-4c37-b1e6-3c1e6dfc35f0 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:06.798210 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.objects.instance [None req-6ec5c95c-951d-4c37-b1e6-3c1e6dfc35f0 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lazy-loading 'flavor' on Instance uuid e7a737cc-6f16-413d-9b3a-d6d32381ffa5 {{(pid=124338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:52:06.827515 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-2c445936-d1e5-412c-a70a-495ccb137de6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1507200184", "imageRef": "844ad823-18a2-4abc-813c-2d1825141591", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "947f6d7f-3e32-4a48-824a-af7e926d3402"}], "security_groups": [{"name": "tempest-securitygroup--238573954"}], "key_name": "tempest-keypair-935810863", "user_data": "}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:52:06.876333 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-6ec5c95c-951d-4c37-b1e6-3c1e6dfc35f0 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "POST /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5/action" status: 202 len: 0 microversion: 2.1 time: 0.114047 Jun 24 09:52:06.877135 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 477/974] 10.222.0.65 () {60 vars in 1277 bytes} [Fri Jun 24 09:52:06 2022] POST /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:52:06.886089 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-9cf3cc15-39d2-41cc-9f25-b32aeb6de85b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:06.886790 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-9cf3cc15-39d2-41cc-9f25-b32aeb6de85b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:06.895217 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9cf3cc15-39d2-41cc-9f25-b32aeb6de85b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:06.895644 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9cf3cc15-39d2-41cc-9f25-b32aeb6de85b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:06.896668 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9cf3cc15-39d2-41cc-9f25-b32aeb6de85b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:06.896955 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-9cf3cc15-39d2-41cc-9f25-b32aeb6de85b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:06.954324 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.network.neutron [None req-2c445936-d1e5-412c-a70a-495ccb137de6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] validate_networks() for [('947f6d7f-3e32-4a48-824a-af7e926d3402', None, None, None, None, None)] {{(pid=124339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:52:07.128990 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-9cf3cc15-39d2-41cc-9f25-b32aeb6de85b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:07.137049 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-9cf3cc15-39d2-41cc-9f25-b32aeb6de85b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1568 microversion: 2.1 time: 0.255370 Jun 24 09:52:07.138136 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 478/975] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:06 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1568 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:52:07.410086 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-2c445936-d1e5-412c-a70a-495ccb137de6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Flavor limits 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:52:07.410513 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-2c445936-d1e5-412c-a70a-495ccb137de6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Image limits 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:52:07.410995 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-2c445936-d1e5-412c-a70a-495ccb137de6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Flavor pref 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:52:07.411434 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-2c445936-d1e5-412c-a70a-495ccb137de6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Image pref 0:0:0 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:52:07.411843 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.virt.hardware [None req-2c445936-d1e5-412c-a70a-495ccb137de6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:52:07.421762 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2c445936-d1e5-412c-a70a-495ccb137de6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:07.422211 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2c445936-d1e5-412c-a70a-495ccb137de6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:07.423029 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2c445936-d1e5-412c-a70a-495ccb137de6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:07.423501 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2c445936-d1e5-412c-a70a-495ccb137de6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:07.440678 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-2c445936-d1e5-412c-a70a-495ccb137de6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Getting quotas for project 9c90246f01ad410ea9569c51eb5f2ecb. Resources: {'cores', 'ram', 'instances'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:52:07.444764 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.quota [None req-2c445936-d1e5-412c-a70a-495ccb137de6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Getting quotas for user 3477f21462c84759b0762cf13427b3c8 and project 9c90246f01ad410ea9569c51eb5f2ecb. Resources: {'cores', 'ram', 'instances'} {{(pid=124339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:52:07.456553 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-2c445936-d1e5-412c-a70a-495ccb137de6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Going to run 1 instances... {{(pid=124339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:52:07.459278 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-2c445936-d1e5-412c-a70a-495ccb137de6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='844ad823-18a2-4abc-813c-2d1825141591',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:52:07.506402 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-2c445936-d1e5-412c-a70a-495ccb137de6 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.683880 Jun 24 09:52:07.507046 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 498/976] 10.222.0.65 () {60 vars in 1146 bytes} [Fri Jun 24 09:52:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 09:52:07.517584 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-c8fb50bf-c9a3-4d57-9376-63906a1d927e tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:07.518209 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-c8fb50bf-c9a3-4d57-9376-63906a1d927e tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:07.573971 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-c8fb50bf-c9a3-4d57-9376-63906a1d927e tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:07.581393 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-c8fb50bf-c9a3-4d57-9376-63906a1d927e tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183" status: 200 len: 1237 microversion: 2.1 time: 0.067763 Jun 24 09:52:07.581947 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 479/977] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:07 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:08.156159 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a52adc39-3eb0-483e-8d78-35dfa25cf017 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:08.156788 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-a52adc39-3eb0-483e-8d78-35dfa25cf017 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:08.164252 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a52adc39-3eb0-483e-8d78-35dfa25cf017 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:08.164710 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a52adc39-3eb0-483e-8d78-35dfa25cf017 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:08.165490 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a52adc39-3eb0-483e-8d78-35dfa25cf017 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:08.165961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a52adc39-3eb0-483e-8d78-35dfa25cf017 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:08.303850 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-a52adc39-3eb0-483e-8d78-35dfa25cf017 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:08.312256 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-a52adc39-3eb0-483e-8d78-35dfa25cf017 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1568 microversion: 2.1 time: 0.160800 Jun 24 09:52:08.313151 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 499/978] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:08 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:08.599121 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-513035d7-3b4f-4996-9327-40bb150aef9b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:08.599733 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-513035d7-3b4f-4996-9327-40bb150aef9b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:08.607318 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-513035d7-3b4f-4996-9327-40bb150aef9b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:08.607776 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-513035d7-3b4f-4996-9327-40bb150aef9b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:08.608563 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-513035d7-3b4f-4996-9327-40bb150aef9b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:08.609182 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-513035d7-3b4f-4996-9327-40bb150aef9b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:08.695836 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-513035d7-3b4f-4996-9327-40bb150aef9b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:08.705342 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-513035d7-3b4f-4996-9327-40bb150aef9b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183" status: 200 len: 1307 microversion: 2.1 time: 0.110007 Jun 24 09:52:08.705911 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 480/979] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:08 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183 => generated 1307 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:09.336204 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-13e0db98-8d49-49ca-941d-ecffdea9ac05 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:09.337607 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-13e0db98-8d49-49ca-941d-ecffdea9ac05 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:09.349993 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-13e0db98-8d49-49ca-941d-ecffdea9ac05 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:09.350845 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-13e0db98-8d49-49ca-941d-ecffdea9ac05 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:09.352117 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-13e0db98-8d49-49ca-941d-ecffdea9ac05 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:09.353157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-13e0db98-8d49-49ca-941d-ecffdea9ac05 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:09.649802 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-13e0db98-8d49-49ca-941d-ecffdea9ac05 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:09.658768 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-13e0db98-8d49-49ca-941d-ecffdea9ac05 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1568 microversion: 2.1 time: 0.331513 Jun 24 09:52:09.659389 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 500/980] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:09 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1568 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:09.724457 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ee4bd4ec-1123-4312-bb63-1d9cbd084049 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:09.725029 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ee4bd4ec-1123-4312-bb63-1d9cbd084049 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:09.732812 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ee4bd4ec-1123-4312-bb63-1d9cbd084049 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:09.733254 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ee4bd4ec-1123-4312-bb63-1d9cbd084049 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:09.734046 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ee4bd4ec-1123-4312-bb63-1d9cbd084049 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:09.734490 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ee4bd4ec-1123-4312-bb63-1d9cbd084049 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:09.966012 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ee4bd4ec-1123-4312-bb63-1d9cbd084049 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:09.977695 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ee4bd4ec-1123-4312-bb63-1d9cbd084049 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183" status: 200 len: 1362 microversion: 2.1 time: 0.257155 Jun 24 09:52:09.978482 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 481/981] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:09 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:10.109625 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-21e5977d-e2e1-41b4-bb69-a3f266f52f5b req-04ce2fdd-846b-457a-a567-4f5dba6bcb1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17b90577-f77b-427f-89a9-a98e267d2183", "tag": "0ecb3a12-19f1-4395-b438-7958968dc2d2"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:52:10.120766 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-21e5977d-e2e1-41b4-bb69-a3f266f52f5b req-04ce2fdd-846b-457a-a567-4f5dba6bcb1a service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:10.121248 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-21e5977d-e2e1-41b4-bb69-a3f266f52f5b req-04ce2fdd-846b-457a-a567-4f5dba6bcb1a service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:10.134803 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-21e5977d-e2e1-41b4-bb69-a3f266f52f5b req-04ce2fdd-846b-457a-a567-4f5dba6bcb1a service nova] Creating event network-changed:0ecb3a12-19f1-4395-b438-7958968dc2d2 for instance 17b90577-f77b-427f-89a9-a98e267d2183 on hv-cinder-80382 Jun 24 09:52:10.140412 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-21e5977d-e2e1-41b4-bb69-a3f266f52f5b req-04ce2fdd-846b-457a-a567-4f5dba6bcb1a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034492 Jun 24 09:52:10.141017 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 501/982] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:52:10.676601 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-d9695fa7-f6d1-4b67-ba5c-d59dcad28559 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:10.677209 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-d9695fa7-f6d1-4b67-ba5c-d59dcad28559 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:10.683916 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d9695fa7-f6d1-4b67-ba5c-d59dcad28559 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:10.684890 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d9695fa7-f6d1-4b67-ba5c-d59dcad28559 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:10.685259 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d9695fa7-f6d1-4b67-ba5c-d59dcad28559 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:10.685701 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d9695fa7-f6d1-4b67-ba5c-d59dcad28559 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:10.822190 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d9695fa7-f6d1-4b67-ba5c-d59dcad28559 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:10.830066 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-d9695fa7-f6d1-4b67-ba5c-d59dcad28559 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1568 microversion: 2.1 time: 0.157557 Jun 24 09:52:10.830646 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 482/983] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:10 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:10.996432 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-513030eb-572f-4cfd-b2b2-bbc98bcc49b5 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:10.997336 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-513030eb-572f-4cfd-b2b2-bbc98bcc49b5 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:11.005318 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-513030eb-572f-4cfd-b2b2-bbc98bcc49b5 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:11.005870 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-513030eb-572f-4cfd-b2b2-bbc98bcc49b5 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:11.006698 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-513030eb-572f-4cfd-b2b2-bbc98bcc49b5 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:11.007183 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-513030eb-572f-4cfd-b2b2-bbc98bcc49b5 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:11.144168 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-513030eb-572f-4cfd-b2b2-bbc98bcc49b5 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:11.152006 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-513030eb-572f-4cfd-b2b2-bbc98bcc49b5 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183" status: 200 len: 1362 microversion: 2.1 time: 0.160528 Jun 24 09:52:11.152553 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 502/984] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:10 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:11.848161 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-c4508d25-51ca-4ecc-a426-db2ba4083490 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:11.848807 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-c4508d25-51ca-4ecc-a426-db2ba4083490 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:11.855812 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c4508d25-51ca-4ecc-a426-db2ba4083490 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:11.856580 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c4508d25-51ca-4ecc-a426-db2ba4083490 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:11.857780 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c4508d25-51ca-4ecc-a426-db2ba4083490 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:11.858223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c4508d25-51ca-4ecc-a426-db2ba4083490 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:12.001531 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-c4508d25-51ca-4ecc-a426-db2ba4083490 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:12.009217 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-c4508d25-51ca-4ecc-a426-db2ba4083490 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1568 microversion: 2.1 time: 0.164992 Jun 24 09:52:12.009785 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 483/985] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:11 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:12.169710 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-dd79e233-5ceb-4ea7-84bb-5d54e82b68f5 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:12.170279 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-dd79e233-5ceb-4ea7-84bb-5d54e82b68f5 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:12.177370 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dd79e233-5ceb-4ea7-84bb-5d54e82b68f5 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:12.177826 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dd79e233-5ceb-4ea7-84bb-5d54e82b68f5 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:12.178605 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dd79e233-5ceb-4ea7-84bb-5d54e82b68f5 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:12.179038 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dd79e233-5ceb-4ea7-84bb-5d54e82b68f5 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:12.320331 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-dd79e233-5ceb-4ea7-84bb-5d54e82b68f5 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:12.329668 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-dd79e233-5ceb-4ea7-84bb-5d54e82b68f5 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183" status: 200 len: 1362 microversion: 2.1 time: 0.164083 Jun 24 09:52:12.330258 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 503/986] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:12 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:13.027374 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-67e426e2-94a2-4b1e-aacd-29f7fac42a61 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:13.028139 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-67e426e2-94a2-4b1e-aacd-29f7fac42a61 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:13.035633 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-67e426e2-94a2-4b1e-aacd-29f7fac42a61 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:13.036144 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-67e426e2-94a2-4b1e-aacd-29f7fac42a61 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:13.036941 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-67e426e2-94a2-4b1e-aacd-29f7fac42a61 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:13.037369 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-67e426e2-94a2-4b1e-aacd-29f7fac42a61 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:13.351636 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-13c990ea-c4de-4bf7-bdb2-40507bca2815 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:13.352285 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-13c990ea-c4de-4bf7-bdb2-40507bca2815 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:13.359508 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-13c990ea-c4de-4bf7-bdb2-40507bca2815 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:13.359961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-13c990ea-c4de-4bf7-bdb2-40507bca2815 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:13.360736 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-13c990ea-c4de-4bf7-bdb2-40507bca2815 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:13.361165 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-13c990ea-c4de-4bf7-bdb2-40507bca2815 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:13.490729 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-67e426e2-94a2-4b1e-aacd-29f7fac42a61 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:13.498856 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-67e426e2-94a2-4b1e-aacd-29f7fac42a61 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1568 microversion: 2.1 time: 0.475428 Jun 24 09:52:13.499473 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 484/987] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:13 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1568 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:13.522574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-13c990ea-c4de-4bf7-bdb2-40507bca2815 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:13.530414 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-13c990ea-c4de-4bf7-bdb2-40507bca2815 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183" status: 200 len: 1362 microversion: 2.1 time: 0.182868 Jun 24 09:52:13.530984 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 504/988] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:13 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:14.518144 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-c8957841-e653-46a7-ac72-717e3fbe7e3c tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:14.518775 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-c8957841-e653-46a7-ac72-717e3fbe7e3c tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:14.526734 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c8957841-e653-46a7-ac72-717e3fbe7e3c tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:14.526959 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c8957841-e653-46a7-ac72-717e3fbe7e3c tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:14.527679 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c8957841-e653-46a7-ac72-717e3fbe7e3c tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:14.528206 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c8957841-e653-46a7-ac72-717e3fbe7e3c tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:14.547670 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-590ee77c-42c6-4fe3-a9d5-9a5a1196cbe7 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:14.548474 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-590ee77c-42c6-4fe3-a9d5-9a5a1196cbe7 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:14.555587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-590ee77c-42c6-4fe3-a9d5-9a5a1196cbe7 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:14.556423 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-590ee77c-42c6-4fe3-a9d5-9a5a1196cbe7 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:14.557502 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-590ee77c-42c6-4fe3-a9d5-9a5a1196cbe7 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:14.557943 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-590ee77c-42c6-4fe3-a9d5-9a5a1196cbe7 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:14.724915 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-c8957841-e653-46a7-ac72-717e3fbe7e3c tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:14.733916 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-c8957841-e653-46a7-ac72-717e3fbe7e3c tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1568 microversion: 2.1 time: 0.221507 Jun 24 09:52:14.734481 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 485/989] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:14 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:14.741365 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-7ec62f83-ff03-4f3e-b127-76e2a404a427 req-c94b0375-236d-4d25-91ca-9a5ead6a84a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b90577-f77b-427f-89a9-a98e267d2183", "name": "network-vif-plugged", "status": "completed", "tag": "0ecb3a12-19f1-4395-b438-7958968dc2d2"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:52:14.750271 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-7ec62f83-ff03-4f3e-b127-76e2a404a427 req-c94b0375-236d-4d25-91ca-9a5ead6a84a0 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:14.750710 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-7ec62f83-ff03-4f3e-b127-76e2a404a427 req-c94b0375-236d-4d25-91ca-9a5ead6a84a0 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:14.759407 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-590ee77c-42c6-4fe3-a9d5-9a5a1196cbe7 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:14.765455 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-7ec62f83-ff03-4f3e-b127-76e2a404a427 req-c94b0375-236d-4d25-91ca-9a5ead6a84a0 service nova] Creating event network-vif-plugged:0ecb3a12-19f1-4395-b438-7958968dc2d2 for instance 17b90577-f77b-427f-89a9-a98e267d2183 on hv-cinder-80382 Jun 24 09:52:14.768007 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-590ee77c-42c6-4fe3-a9d5-9a5a1196cbe7 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183" status: 200 len: 1362 microversion: 2.1 time: 0.224385 Jun 24 09:52:14.768957 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 505/990] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:14 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:52:14.771153 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-7ec62f83-ff03-4f3e-b127-76e2a404a427 req-c94b0375-236d-4d25-91ca-9a5ead6a84a0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035280 Jun 24 09:52:14.771787 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 486/991] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:52:15.752405 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-dd2c2c90-3728-4d74-b27e-eecc4f3e8fd1 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:15.753091 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-dd2c2c90-3728-4d74-b27e-eecc4f3e8fd1 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:15.761299 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dd2c2c90-3728-4d74-b27e-eecc4f3e8fd1 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:15.761757 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dd2c2c90-3728-4d74-b27e-eecc4f3e8fd1 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:15.762749 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dd2c2c90-3728-4d74-b27e-eecc4f3e8fd1 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:15.763428 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-dd2c2c90-3728-4d74-b27e-eecc4f3e8fd1 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:15.785511 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-d458e4c6-cd1e-4af1-84fa-2f704f40df3a tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:15.786868 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-d458e4c6-cd1e-4af1-84fa-2f704f40df3a tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:15.795486 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d458e4c6-cd1e-4af1-84fa-2f704f40df3a tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:15.796223 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d458e4c6-cd1e-4af1-84fa-2f704f40df3a tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:15.797008 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d458e4c6-cd1e-4af1-84fa-2f704f40df3a tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:15.797449 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d458e4c6-cd1e-4af1-84fa-2f704f40df3a tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:15.956024 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-dd2c2c90-3728-4d74-b27e-eecc4f3e8fd1 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:15.964072 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-dd2c2c90-3728-4d74-b27e-eecc4f3e8fd1 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1568 microversion: 2.1 time: 0.216521 Jun 24 09:52:15.964687 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 506/992] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:15 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:15.980196 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-d458e4c6-cd1e-4af1-84fa-2f704f40df3a tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:15.988132 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-d458e4c6-cd1e-4af1-84fa-2f704f40df3a tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183" status: 200 len: 1362 microversion: 2.1 time: 0.206959 Jun 24 09:52:15.988697 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 487/993] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:15 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:16.981648 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c0b54de5-68b7-49db-935f-b2de9bf6f60b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:16.982251 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-c0b54de5-68b7-49db-935f-b2de9bf6f60b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:16.989209 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c0b54de5-68b7-49db-935f-b2de9bf6f60b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:16.989657 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c0b54de5-68b7-49db-935f-b2de9bf6f60b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:16.990422 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c0b54de5-68b7-49db-935f-b2de9bf6f60b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:16.990852 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c0b54de5-68b7-49db-935f-b2de9bf6f60b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:17.005728 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-b392b145-f091-4574-820c-43c54ad888a8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:17.006421 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-b392b145-f091-4574-820c-43c54ad888a8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:17.013573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b392b145-f091-4574-820c-43c54ad888a8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:17.014055 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b392b145-f091-4574-820c-43c54ad888a8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:17.014840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b392b145-f091-4574-820c-43c54ad888a8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:17.015327 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b392b145-f091-4574-820c-43c54ad888a8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:17.285101 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c0b54de5-68b7-49db-935f-b2de9bf6f60b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:17.293035 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-c0b54de5-68b7-49db-935f-b2de9bf6f60b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1568 microversion: 2.1 time: 0.315355 Jun 24 09:52:17.293858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 507/994] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:16 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1568 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:17.306993 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-b392b145-f091-4574-820c-43c54ad888a8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:17.315236 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-b392b145-f091-4574-820c-43c54ad888a8 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183" status: 200 len: 1548 microversion: 2.1 time: 0.313395 Jun 24 09:52:17.315852 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 488/995] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:17 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183 => generated 1548 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:17.332075 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3632e589-b88f-4a7e-92c9-ddb1a04ba8a0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:17.332920 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3632e589-b88f-4a7e-92c9-ddb1a04ba8a0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:17.339213 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3632e589-b88f-4a7e-92c9-ddb1a04ba8a0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:17.339674 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3632e589-b88f-4a7e-92c9-ddb1a04ba8a0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:17.340448 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3632e589-b88f-4a7e-92c9-ddb1a04ba8a0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:17.340879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3632e589-b88f-4a7e-92c9-ddb1a04ba8a0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:17.430708 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=2 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:17.434225 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3632e589-b88f-4a7e-92c9-ddb1a04ba8a0 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106138 Jun 24 09:52:17.435114 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 508/996] 10.222.0.65 () {58 vars in 1274 bytes} [Fri Jun 24 09:52:17 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:52:18.311111 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-8039be47-8f39-4aef-8e6b-0758a6f78ed8 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:18.311741 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-8039be47-8f39-4aef-8e6b-0758a6f78ed8 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:18.313825 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=2 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:18.320002 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8039be47-8f39-4aef-8e6b-0758a6f78ed8 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:18.320451 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8039be47-8f39-4aef-8e6b-0758a6f78ed8 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:18.321227 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8039be47-8f39-4aef-8e6b-0758a6f78ed8 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:18.321660 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8039be47-8f39-4aef-8e6b-0758a6f78ed8 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:18.327003 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:18.444823 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-5167596a-769f-46b0-bda8-202417b2aa5b req-9d50b0a0-128f-4883-a5c4-a4d4e2a077ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17b90577-f77b-427f-89a9-a98e267d2183", "tag": "0ecb3a12-19f1-4395-b438-7958968dc2d2"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:52:18.452502 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=10 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:18.455718 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-5167596a-769f-46b0-bda8-202417b2aa5b req-9d50b0a0-128f-4883-a5c4-a4d4e2a077ff service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:18.456265 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-5167596a-769f-46b0-bda8-202417b2aa5b req-9d50b0a0-128f-4883-a5c4-a4d4e2a077ff service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:18.471362 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-5167596a-769f-46b0-bda8-202417b2aa5b req-9d50b0a0-128f-4883-a5c4-a4d4e2a077ff service nova] Creating event network-changed:0ecb3a12-19f1-4395-b438-7958968dc2d2 for instance 17b90577-f77b-427f-89a9-a98e267d2183 on hv-cinder-80382 Jun 24 09:52:18.476581 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-5167596a-769f-46b0-bda8-202417b2aa5b req-9d50b0a0-128f-4883-a5c4-a4d4e2a077ff service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035493 Jun 24 09:52:18.477492 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 509/997] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:52:18.478081 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-8039be47-8f39-4aef-8e6b-0758a6f78ed8 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:18.487928 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-8039be47-8f39-4aef-8e6b-0758a6f78ed8 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1568 microversion: 2.1 time: 0.180981 Jun 24 09:52:18.488490 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 489/998] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:18 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:19.506725 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-4377d14f-0299-4989-a024-2f3e7a45c766 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:19.507748 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-4377d14f-0299-4989-a024-2f3e7a45c766 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:19.516469 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4377d14f-0299-4989-a024-2f3e7a45c766 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:19.517240 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4377d14f-0299-4989-a024-2f3e7a45c766 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:19.518390 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4377d14f-0299-4989-a024-2f3e7a45c766 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:19.518986 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-4377d14f-0299-4989-a024-2f3e7a45c766 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:19.683133 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-4377d14f-0299-4989-a024-2f3e7a45c766 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:19.692184 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-4377d14f-0299-4989-a024-2f3e7a45c766 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1568 microversion: 2.1 time: 0.190737 Jun 24 09:52:19.692761 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 510/999] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:19 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:20.710544 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-2448731e-ba99-42d7-b0a7-606f9d5c2a65 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:20.711340 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-2448731e-ba99-42d7-b0a7-606f9d5c2a65 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:20.718918 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2448731e-ba99-42d7-b0a7-606f9d5c2a65 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:20.719431 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2448731e-ba99-42d7-b0a7-606f9d5c2a65 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:20.720211 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2448731e-ba99-42d7-b0a7-606f9d5c2a65 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:20.720638 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2448731e-ba99-42d7-b0a7-606f9d5c2a65 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:20.856348 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-2448731e-ba99-42d7-b0a7-606f9d5c2a65 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:20.864623 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-2448731e-ba99-42d7-b0a7-606f9d5c2a65 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1509 microversion: 2.1 time: 0.158383 Jun 24 09:52:20.865193 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 490/1000] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:20 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:20.881291 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-44e87da5-9306-47bf-a26c-ff4acea917bc tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:52:20.881894 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-44e87da5-9306-47bf-a26c-ff4acea917bc tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:20.888856 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-44e87da5-9306-47bf-a26c-ff4acea917bc tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:20.889331 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-44e87da5-9306-47bf-a26c-ff4acea917bc tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:20.890103 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-44e87da5-9306-47bf-a26c-ff4acea917bc tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:20.890535 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-44e87da5-9306-47bf-a26c-ff4acea917bc tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:20.967847 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-44e87da5-9306-47bf-a26c-ff4acea917bc tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "POST /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5/action" status: 202 len: 0 microversion: 2.1 time: 0.090448 Jun 24 09:52:20.970539 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 511/1001] 10.222.0.65 () {60 vars in 1277 bytes} [Fri Jun 24 09:52:20 2022] POST /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:52:20.977577 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-20a777dc-c675-4157-9520-dce92ea5be76 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:20.978206 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-20a777dc-c675-4157-9520-dce92ea5be76 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:20.985479 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-20a777dc-c675-4157-9520-dce92ea5be76 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:20.985922 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-20a777dc-c675-4157-9520-dce92ea5be76 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:20.986731 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-20a777dc-c675-4157-9520-dce92ea5be76 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:20.987188 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-20a777dc-c675-4157-9520-dce92ea5be76 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:21.131232 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-20a777dc-c675-4157-9520-dce92ea5be76 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:21.140635 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-20a777dc-c675-4157-9520-dce92ea5be76 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1517 microversion: 2.1 time: 0.167525 Jun 24 09:52:21.141194 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 491/1002] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:20 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:22.158716 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-26a339d8-e900-44f5-aa5f-08cb7c3da61d tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:22.159458 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-26a339d8-e900-44f5-aa5f-08cb7c3da61d tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:22.165948 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-26a339d8-e900-44f5-aa5f-08cb7c3da61d tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:22.166401 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-26a339d8-e900-44f5-aa5f-08cb7c3da61d tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:22.167218 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-26a339d8-e900-44f5-aa5f-08cb7c3da61d tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:22.167660 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-26a339d8-e900-44f5-aa5f-08cb7c3da61d tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:22.186845 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:22.305441 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-26a339d8-e900-44f5-aa5f-08cb7c3da61d tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:22.314904 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-26a339d8-e900-44f5-aa5f-08cb7c3da61d tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1575 microversion: 2.1 time: 0.160794 Jun 24 09:52:22.315537 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 512/1003] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:22 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:22.553369 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-e18d0f57-bea5-4aa1-81ca-edb851731604 req-585e4925-62f6-4253-b75f-0accd72120ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a737cc-6f16-413d-9b3a-d6d32381ffa5", "name": "network-vif-unplugged", "status": "completed", "tag": "ab20f504-ef6d-409e-9d0c-3918f4bb9c57"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:52:22.562555 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-e18d0f57-bea5-4aa1-81ca-edb851731604 req-585e4925-62f6-4253-b75f-0accd72120ee service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:22.563351 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-e18d0f57-bea5-4aa1-81ca-edb851731604 req-585e4925-62f6-4253-b75f-0accd72120ee service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:22.577406 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-e18d0f57-bea5-4aa1-81ca-edb851731604 req-585e4925-62f6-4253-b75f-0accd72120ee service nova] Creating event network-vif-unplugged:ab20f504-ef6d-409e-9d0c-3918f4bb9c57 for instance e7a737cc-6f16-413d-9b3a-d6d32381ffa5 on hv-cinder-80382 Jun 24 09:52:22.583159 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-e18d0f57-bea5-4aa1-81ca-edb851731604 req-585e4925-62f6-4253-b75f-0accd72120ee service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033053 Jun 24 09:52:22.584137 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 492/1004] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:52:23.337946 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-25361b11-7a87-45bf-80fb-87436b848095 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:23.338601 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-25361b11-7a87-45bf-80fb-87436b848095 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:23.345708 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-25361b11-7a87-45bf-80fb-87436b848095 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:23.346157 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-25361b11-7a87-45bf-80fb-87436b848095 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:23.346935 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-25361b11-7a87-45bf-80fb-87436b848095 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:23.347397 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-25361b11-7a87-45bf-80fb-87436b848095 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:23.488379 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-25361b11-7a87-45bf-80fb-87436b848095 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:23.498885 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-25361b11-7a87-45bf-80fb-87436b848095 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1575 microversion: 2.1 time: 0.164866 Jun 24 09:52:23.499546 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 513/1005] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:23 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:24.519387 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-2103d41d-e7ff-46b2-8308-de5881fff54e tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:24.520106 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-2103d41d-e7ff-46b2-8308-de5881fff54e tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:24.526785 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2103d41d-e7ff-46b2-8308-de5881fff54e tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:24.527278 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2103d41d-e7ff-46b2-8308-de5881fff54e tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:24.528049 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2103d41d-e7ff-46b2-8308-de5881fff54e tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:24.528481 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-2103d41d-e7ff-46b2-8308-de5881fff54e tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:24.668172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-2103d41d-e7ff-46b2-8308-de5881fff54e tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:24.676504 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-2103d41d-e7ff-46b2-8308-de5881fff54e tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1575 microversion: 2.1 time: 0.162261 Jun 24 09:52:24.677091 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 493/1006] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:24 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:25.697038 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-6b1772d1-4109-40cd-b4fc-b7af30eafd8a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:25.697678 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-6b1772d1-4109-40cd-b4fc-b7af30eafd8a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:25.708250 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6b1772d1-4109-40cd-b4fc-b7af30eafd8a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:25.708847 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6b1772d1-4109-40cd-b4fc-b7af30eafd8a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:25.709973 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6b1772d1-4109-40cd-b4fc-b7af30eafd8a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:25.710603 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-6b1772d1-4109-40cd-b4fc-b7af30eafd8a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:25.896793 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-6b1772d1-4109-40cd-b4fc-b7af30eafd8a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:25.905845 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-6b1772d1-4109-40cd-b4fc-b7af30eafd8a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1575 microversion: 2.1 time: 0.214822 Jun 24 09:52:25.906431 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 514/1007] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:25 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:26.924854 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-86b36d40-f316-4259-9536-8c4b9bb0c7a2 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:26.925534 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-86b36d40-f316-4259-9536-8c4b9bb0c7a2 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:26.932655 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-86b36d40-f316-4259-9536-8c4b9bb0c7a2 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:26.933108 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-86b36d40-f316-4259-9536-8c4b9bb0c7a2 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:26.933887 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-86b36d40-f316-4259-9536-8c4b9bb0c7a2 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:26.934320 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-86b36d40-f316-4259-9536-8c4b9bb0c7a2 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:27.066073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-86b36d40-f316-4259-9536-8c4b9bb0c7a2 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:27.074117 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-86b36d40-f316-4259-9536-8c4b9bb0c7a2 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1575 microversion: 2.1 time: 0.153685 Jun 24 09:52:27.074922 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 494/1008] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:26 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:28.092460 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-ed47aec5-4433-4aa6-94e7-68b38bb60f5c tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:28.093111 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-ed47aec5-4433-4aa6-94e7-68b38bb60f5c tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:28.099898 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ed47aec5-4433-4aa6-94e7-68b38bb60f5c tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:28.100345 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ed47aec5-4433-4aa6-94e7-68b38bb60f5c tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:28.101112 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ed47aec5-4433-4aa6-94e7-68b38bb60f5c tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:28.101540 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ed47aec5-4433-4aa6-94e7-68b38bb60f5c tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:28.248284 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-ed47aec5-4433-4aa6-94e7-68b38bb60f5c tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:28.256251 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-ed47aec5-4433-4aa6-94e7-68b38bb60f5c tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1575 microversion: 2.1 time: 0.168082 Jun 24 09:52:28.256822 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 515/1009] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:28 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:29.275463 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ffd80304-d447-45f5-a52a-c963479c3d53 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:29.276346 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ffd80304-d447-45f5-a52a-c963479c3d53 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:29.287068 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ffd80304-d447-45f5-a52a-c963479c3d53 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:29.287722 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ffd80304-d447-45f5-a52a-c963479c3d53 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:29.288597 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ffd80304-d447-45f5-a52a-c963479c3d53 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:29.289023 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ffd80304-d447-45f5-a52a-c963479c3d53 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:29.426908 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ffd80304-d447-45f5-a52a-c963479c3d53 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:29.435386 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ffd80304-d447-45f5-a52a-c963479c3d53 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1575 microversion: 2.1 time: 0.165339 Jun 24 09:52:29.435995 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 495/1010] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:29 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:30.454659 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-2d4cd921-60ab-452f-9972-24ef386ae516 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:30.455340 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-2d4cd921-60ab-452f-9972-24ef386ae516 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:30.469499 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2d4cd921-60ab-452f-9972-24ef386ae516 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:30.469951 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2d4cd921-60ab-452f-9972-24ef386ae516 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:30.470703 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2d4cd921-60ab-452f-9972-24ef386ae516 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:30.471151 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-2d4cd921-60ab-452f-9972-24ef386ae516 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:30.623449 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-2d4cd921-60ab-452f-9972-24ef386ae516 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:52:30.631520 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-2d4cd921-60ab-452f-9972-24ef386ae516 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1562 microversion: 2.1 time: 0.181215 Jun 24 09:52:30.632344 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 516/1011] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:52:30 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1562 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:52:32.656421 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-be629f81-bbeb-496d-aa24-4fb6948e918c req-e0094d93-4caa-4913-9480-011e1339f355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a737cc-6f16-413d-9b3a-d6d32381ffa5", "name": "network-vif-plugged", "status": "completed", "tag": "ab20f504-ef6d-409e-9d0c-3918f4bb9c57"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:52:32.660970 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:32.670859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-be629f81-bbeb-496d-aa24-4fb6948e918c req-e0094d93-4caa-4913-9480-011e1339f355 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:32.671604 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-be629f81-bbeb-496d-aa24-4fb6948e918c req-e0094d93-4caa-4913-9480-011e1339f355 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:32.684149 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-be629f81-bbeb-496d-aa24-4fb6948e918c req-e0094d93-4caa-4913-9480-011e1339f355 service nova] Creating event network-vif-plugged:ab20f504-ef6d-409e-9d0c-3918f4bb9c57 for instance e7a737cc-6f16-413d-9b3a-d6d32381ffa5 on hv-cinder-80382 Jun 24 09:52:32.689419 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-be629f81-bbeb-496d-aa24-4fb6948e918c req-e0094d93-4caa-4913-9480-011e1339f355 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037546 Jun 24 09:52:32.690131 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 496/1012] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:52:54.631495 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-b68f92ef-e586-4b77-a92a-705abadfa634 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:54.632115 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-b68f92ef-e586-4b77-a92a-705abadfa634 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:54.634621 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:54.635303 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=26 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:54.641495 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b68f92ef-e586-4b77-a92a-705abadfa634 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:54.641947 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b68f92ef-e586-4b77-a92a-705abadfa634 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:54.642709 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b68f92ef-e586-4b77-a92a-705abadfa634 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:54.643174 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-b68f92ef-e586-4b77-a92a-705abadfa634 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:54.669226 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-b68f92ef-e586-4b77-a92a-705abadfa634 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/ips" status: 200 len: 145 microversion: 2.1 time: 0.041787 Jun 24 09:52:54.669815 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 517/1013] 10.222.0.65 () {58 vars in 1247 bytes} [Fri Jun 24 09:52:54 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:52:56.022992 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=38 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:56.023782 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=1 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:56.028283 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-d08e88f2-31a3-44bb-949c-ae03c702eb49 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94e8e4e9-3daa-4f64-9e91-3d91e29b3a82"}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:52:56.029438 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-d08e88f2-31a3-44bb-949c-ae03c702eb49 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:52:56.036785 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d08e88f2-31a3-44bb-949c-ae03c702eb49 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:56.037232 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d08e88f2-31a3-44bb-949c-ae03c702eb49 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:56.038006 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d08e88f2-31a3-44bb-949c-ae03c702eb49 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:56.038443 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-d08e88f2-31a3-44bb-949c-ae03c702eb49 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:56.306927 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-d08e88f2-31a3-44bb-949c-ae03c702eb49 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "POST /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285250 Jun 24 09:52:56.307591 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 497/1014] 10.222.0.65 () {60 vars in 1322 bytes} [Fri Jun 24 09:52:56 2022] POST /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:53:02.815363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-ff6f05d4-7edd-4791-8c0c-a6599a0f3639 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:02.816560 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-ff6f05d4-7edd-4791-8c0c-a6599a0f3639 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:02.826045 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ff6f05d4-7edd-4791-8c0c-a6599a0f3639 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:02.826503 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ff6f05d4-7edd-4791-8c0c-a6599a0f3639 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:02.827352 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ff6f05d4-7edd-4791-8c0c-a6599a0f3639 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:02.827795 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ff6f05d4-7edd-4791-8c0c-a6599a0f3639 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:02.861350 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-ff6f05d4-7edd-4791-8c0c-a6599a0f3639 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052299 Jun 24 09:53:02.861829 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 518/1015] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:53:02 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:53:02.872786 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ddcfb808-3a3b-41ec-8417-e552bb3aae00 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:02.873375 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ddcfb808-3a3b-41ec-8417-e552bb3aae00 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:02.880519 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ddcfb808-3a3b-41ec-8417-e552bb3aae00 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:02.880966 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ddcfb808-3a3b-41ec-8417-e552bb3aae00 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:02.881744 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ddcfb808-3a3b-41ec-8417-e552bb3aae00 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:02.882172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ddcfb808-3a3b-41ec-8417-e552bb3aae00 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:02.912509 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ddcfb808-3a3b-41ec-8417-e552bb3aae00 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-volume_attachments/94e8e4e9-3daa-4f64-9e91-3d91e29b3a82" status: 200 len: 194 microversion: 2.1 time: 0.044257 Jun 24 09:53:02.913116 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 498/1016] 10.222.0.65 () {58 vars in 1412 bytes} [Fri Jun 24 09:53:02 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-volume_attachments/94e8e4e9-3daa-4f64-9e91-3d91e29b3a82 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:53:04.261733 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-14d9df22-bfd5-49f2-b41c-74f3f045e44c tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f2917c5-98ef-48ae-9c09-acd0d71523c9"}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:53:04.262831 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-14d9df22-bfd5-49f2-b41c-74f3f045e44c tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:04.269787 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-14d9df22-bfd5-49f2-b41c-74f3f045e44c tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:04.270208 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-14d9df22-bfd5-49f2-b41c-74f3f045e44c tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:04.270985 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-14d9df22-bfd5-49f2-b41c-74f3f045e44c tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:04.271464 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-14d9df22-bfd5-49f2-b41c-74f3f045e44c tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:04.556895 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-14d9df22-bfd5-49f2-b41c-74f3f045e44c tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "POST /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300644 Jun 24 09:53:04.557532 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 519/1017] 10.222.0.65 () {60 vars in 1322 bytes} [Fri Jun 24 09:53:04 2022] POST /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:53:12.076963 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-c53a2a09-b643-411b-8fe6-1d5d324891d2 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:12.078068 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-c53a2a09-b643-411b-8fe6-1d5d324891d2 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:12.086092 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c53a2a09-b643-411b-8fe6-1d5d324891d2 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:12.086532 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c53a2a09-b643-411b-8fe6-1d5d324891d2 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:12.087386 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c53a2a09-b643-411b-8fe6-1d5d324891d2 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:12.087933 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-c53a2a09-b643-411b-8fe6-1d5d324891d2 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:12.124296 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-c53a2a09-b643-411b-8fe6-1d5d324891d2 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051415 Jun 24 09:53:12.124860 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 499/1018] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:53:12 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:53:12.273605 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-54161f91-2020-488d-bf21-68a6ee8e40f1 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:12.274152 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-54161f91-2020-488d-bf21-68a6ee8e40f1 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:12.281786 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-54161f91-2020-488d-bf21-68a6ee8e40f1 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:12.282227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-54161f91-2020-488d-bf21-68a6ee8e40f1 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:12.282982 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-54161f91-2020-488d-bf21-68a6ee8e40f1 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:12.283454 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-54161f91-2020-488d-bf21-68a6ee8e40f1 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:12.315302 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-54161f91-2020-488d-bf21-68a6ee8e40f1 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-volume_attachments/94e8e4e9-3daa-4f64-9e91-3d91e29b3a82" status: 200 len: 194 microversion: 2.1 time: 0.046151 Jun 24 09:53:12.315906 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 520/1019] 10.222.0.65 () {58 vars in 1412 bytes} [Fri Jun 24 09:53:12 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-volume_attachments/94e8e4e9-3daa-4f64-9e91-3d91e29b3a82 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:53:12.325944 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-b75aca40-e0e1-49fa-a053-bd030ff98736 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:12.326438 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-b75aca40-e0e1-49fa-a053-bd030ff98736 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:12.335714 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b75aca40-e0e1-49fa-a053-bd030ff98736 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:12.336324 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b75aca40-e0e1-49fa-a053-bd030ff98736 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:12.337371 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b75aca40-e0e1-49fa-a053-bd030ff98736 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:12.337827 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b75aca40-e0e1-49fa-a053-bd030ff98736 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:12.429777 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.objects.instance [None req-b75aca40-e0e1-49fa-a053-bd030ff98736 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lazy-loading 'services' on Instance uuid 17b90577-f77b-427f-89a9-a98e267d2183 {{(pid=124338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:53:12.513265 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-b75aca40-e0e1-49fa-a053-bd030ff98736 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "DELETE /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-volume_attachments/94e8e4e9-3daa-4f64-9e91-3d91e29b3a82" status: 202 len: 0 microversion: 2.1 time: 0.191217 Jun 24 09:53:12.513902 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 500/1020] 10.222.0.65 () {58 vars in 1415 bytes} [Fri Jun 24 09:53:12 2022] DELETE /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-volume_attachments/94e8e4e9-3daa-4f64-9e91-3d91e29b3a82 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:53:13.647844 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-85c1235d-37f2-4a10-9bcc-1b26d1a1aa1c tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:13.648413 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-85c1235d-37f2-4a10-9bcc-1b26d1a1aa1c tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:13.655060 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-85c1235d-37f2-4a10-9bcc-1b26d1a1aa1c tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:13.655541 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-85c1235d-37f2-4a10-9bcc-1b26d1a1aa1c tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:13.656324 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-85c1235d-37f2-4a10-9bcc-1b26d1a1aa1c tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:13.656764 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-85c1235d-37f2-4a10-9bcc-1b26d1a1aa1c tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:13.688696 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-85c1235d-37f2-4a10-9bcc-1b26d1a1aa1c tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-volume_attachments/1f2917c5-98ef-48ae-9c09-acd0d71523c9" status: 200 len: 194 microversion: 2.1 time: 0.044899 Jun 24 09:53:13.689611 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 521/1021] 10.222.0.65 () {58 vars in 1412 bytes} [Fri Jun 24 09:53:13 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-volume_attachments/1f2917c5-98ef-48ae-9c09-acd0d71523c9 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:53:13.701570 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-4c86bda2-0191-4bd5-a827-5ec5f579586f tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:13.702125 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-4c86bda2-0191-4bd5-a827-5ec5f579586f tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:13.709174 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-4c86bda2-0191-4bd5-a827-5ec5f579586f tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:13.709621 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-4c86bda2-0191-4bd5-a827-5ec5f579586f tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:13.710404 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-4c86bda2-0191-4bd5-a827-5ec5f579586f tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:13.710838 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-4c86bda2-0191-4bd5-a827-5ec5f579586f tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:13.808109 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.objects.instance [None req-4c86bda2-0191-4bd5-a827-5ec5f579586f tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lazy-loading 'services' on Instance uuid 17b90577-f77b-427f-89a9-a98e267d2183 {{(pid=124338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:53:13.899583 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-4c86bda2-0191-4bd5-a827-5ec5f579586f tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "DELETE /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-volume_attachments/1f2917c5-98ef-48ae-9c09-acd0d71523c9" status: 202 len: 0 microversion: 2.1 time: 0.203128 Jun 24 09:53:13.900187 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 501/1022] 10.222.0.65 () {58 vars in 1415 bytes} [Fri Jun 24 09:53:13 2022] DELETE /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-volume_attachments/1f2917c5-98ef-48ae-9c09-acd0d71523c9 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:53:15.079678 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a0cd26b3-b835-4cc5-89c7-800eae8358ef tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:15.080674 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-a0cd26b3-b835-4cc5-89c7-800eae8358ef tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:15.088840 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a0cd26b3-b835-4cc5-89c7-800eae8358ef tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:15.089283 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a0cd26b3-b835-4cc5-89c7-800eae8358ef tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:15.090064 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a0cd26b3-b835-4cc5-89c7-800eae8358ef tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:15.090488 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a0cd26b3-b835-4cc5-89c7-800eae8358ef tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:15.124104 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-a0cd26b3-b835-4cc5-89c7-800eae8358ef tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048472 Jun 24 09:53:15.124690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 522/1023] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:53:15 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 09:53:15.241284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-a704ab2a-9921-445e-9b88-35dacf0f9e0b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:15.242196 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-a704ab2a-9921-445e-9b88-35dacf0f9e0b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:15.248942 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a704ab2a-9921-445e-9b88-35dacf0f9e0b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:15.249384 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a704ab2a-9921-445e-9b88-35dacf0f9e0b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:15.250159 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a704ab2a-9921-445e-9b88-35dacf0f9e0b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:15.250593 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-a704ab2a-9921-445e-9b88-35dacf0f9e0b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:15.281416 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-a704ab2a-9921-445e-9b88-35dacf0f9e0b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045303 Jun 24 09:53:15.281987 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 502/1024] 10.222.0.65 () {58 vars in 1301 bytes} [Fri Jun 24 09:53:15 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 09:53:15.347705 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-9e148f92-7fe3-4b58-b3cd-ae95278cc309 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:15.348198 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-9e148f92-7fe3-4b58-b3cd-ae95278cc309 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:15.355728 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9e148f92-7fe3-4b58-b3cd-ae95278cc309 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:15.356175 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9e148f92-7fe3-4b58-b3cd-ae95278cc309 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:15.356993 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9e148f92-7fe3-4b58-b3cd-ae95278cc309 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:15.357419 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9e148f92-7fe3-4b58-b3cd-ae95278cc309 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:15.386336 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-9e148f92-7fe3-4b58-b3cd-ae95278cc309 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Going to try to terminate instance {{(pid=124339) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:53:15.471320 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-9e148f92-7fe3-4b58-b3cd-ae95278cc309 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "DELETE /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183" status: 204 len: 0 microversion: 2.1 time: 0.127156 Jun 24 09:53:15.472185 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 523/1025] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:53:15 2022] DELETE /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:53:15.480706 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-8cf8cf55-6a48-4913-9009-2d605d5609fd tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:15.481345 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-8cf8cf55-6a48-4913-9009-2d605d5609fd tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:15.487870 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8cf8cf55-6a48-4913-9009-2d605d5609fd tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:15.488326 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8cf8cf55-6a48-4913-9009-2d605d5609fd tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:15.489114 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8cf8cf55-6a48-4913-9009-2d605d5609fd tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:15.489645 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-8cf8cf55-6a48-4913-9009-2d605d5609fd tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:15.625727 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-8cf8cf55-6a48-4913-9009-2d605d5609fd tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:53:15.634104 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-8cf8cf55-6a48-4913-9009-2d605d5609fd tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183" status: 200 len: 1672 microversion: 2.1 time: 0.157449 Jun 24 09:53:15.634690 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 503/1026] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:15 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:16.653557 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-8d7f9a76-aa64-4f63-92ac-bef0bd7bad88 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:16.654266 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-8d7f9a76-aa64-4f63-92ac-bef0bd7bad88 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:16.661555 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8d7f9a76-aa64-4f63-92ac-bef0bd7bad88 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:16.662094 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8d7f9a76-aa64-4f63-92ac-bef0bd7bad88 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:16.662961 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8d7f9a76-aa64-4f63-92ac-bef0bd7bad88 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:16.663439 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8d7f9a76-aa64-4f63-92ac-bef0bd7bad88 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:16.813587 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-8d7f9a76-aa64-4f63-92ac-bef0bd7bad88 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:53:16.822820 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-8d7f9a76-aa64-4f63-92ac-bef0bd7bad88 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183" status: 200 len: 1672 microversion: 2.1 time: 0.173907 Jun 24 09:53:16.823447 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 524/1027] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:16 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183 => generated 1672 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:17.844345 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-b9f867da-8056-4751-bac0-40296c09ee1d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:17.844989 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-b9f867da-8056-4751-bac0-40296c09ee1d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:17.852361 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b9f867da-8056-4751-bac0-40296c09ee1d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:17.852815 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b9f867da-8056-4751-bac0-40296c09ee1d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:17.853875 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b9f867da-8056-4751-bac0-40296c09ee1d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:17.854422 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-b9f867da-8056-4751-bac0-40296c09ee1d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:17.956196 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-b9f867da-8056-4751-bac0-40296c09ee1d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3477f21462c84759b0762cf13427b3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c90246f01ad410ea9569c51eb5f2ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:53:17.966539 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-b9f867da-8056-4751-bac0-40296c09ee1d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183" status: 200 len: 1605 microversion: 2.1 time: 0.125973 Jun 24 09:53:17.967047 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 504/1028] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:17 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183 => generated 1605 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:18.118179 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-70387ca5-0b8e-4864-8fa5-325beb043ae9 req-0fbf3604-f476-42bd-b320-2b46f76324b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b90577-f77b-427f-89a9-a98e267d2183", "name": "network-vif-deleted", "tag": "0ecb3a12-19f1-4395-b438-7958968dc2d2"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:53:18.137333 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-70387ca5-0b8e-4864-8fa5-325beb043ae9 req-0fbf3604-f476-42bd-b320-2b46f76324b5 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:18.138245 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-70387ca5-0b8e-4864-8fa5-325beb043ae9 req-0fbf3604-f476-42bd-b320-2b46f76324b5 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:18.157232 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-70387ca5-0b8e-4864-8fa5-325beb043ae9 req-0fbf3604-f476-42bd-b320-2b46f76324b5 service nova] Creating event network-vif-deleted:0ecb3a12-19f1-4395-b438-7958968dc2d2 for instance 17b90577-f77b-427f-89a9-a98e267d2183 on hv-cinder-80382 Jun 24 09:53:18.162939 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-70387ca5-0b8e-4864-8fa5-325beb043ae9 req-0fbf3604-f476-42bd-b320-2b46f76324b5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134041 Jun 24 09:53:18.163662 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 525/1029] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:53:18.985584 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-dddc5e78-fa29-458d-86ec-93845eda244b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:18.986527 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-dddc5e78-fa29-458d-86ec-93845eda244b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:18.996733 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-dddc5e78-fa29-458d-86ec-93845eda244b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:18.997421 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-dddc5e78-fa29-458d-86ec-93845eda244b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:18.998612 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-dddc5e78-fa29-458d-86ec-93845eda244b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:18.999315 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-dddc5e78-fa29-458d-86ec-93845eda244b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:19.015826 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.wsgi [None req-dddc5e78-fa29-458d-86ec-93845eda244b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] HTTP exception thrown: Instance 17b90577-f77b-427f-89a9-a98e267d2183 could not be found. Jun 24 09:53:19.017642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-dddc5e78-fa29-458d-86ec-93845eda244b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Request method failure captured: Jun 24 09:53:19.017642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183 HTTP/1.1 Jun 24 09:53:19.017642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:53:19.017642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:53:19.017642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:53:19.017642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 0 Jun 24 09:53:19.017642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:53:19.017642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:53:19.017642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:53:19.017642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:53:19.017642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYigaj_ai9ZCtd1IPsoyIM3aZwQaxq_4zYiPV5tiqrQNTUM5jL0zuvOJJLIhUAQLcrT5lyoJRR5piqJAjuzLoOzIsIr3uBUYgSYViJydaauzIBIWF16GWl67WSJymfv6AIx8C8SLIqEP3guZY0k7DnhjHMsFMBH31MDp_90KswhzexE Jun 24 09:53:19.017642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:53:19.017642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:53:19.017642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:53:19.017642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:53:19.017642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:53:19.017642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:53:19.017642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: 9c90246f01ad410ea9569c51eb5f2ecb Jun 24 09:53:19.017642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-AttachVolumeTestJSON-681977095 Jun 24 09:53:19.017642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:53:19.017642 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:53:19.019859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9c90246f01ad410ea9569c51eb5f2ecb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9c90246f01ad410ea9569c51eb5f2ecb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9c90246f01ad410ea9569c51eb5f2ecb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9c90246f01ad410ea9569c51eb5f2ecb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:53:19.019859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-AttachVolumeTestJSON-681977095 Jun 24 09:53:19.019859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: 9c90246f01ad410ea9569c51eb5f2ecb Jun 24 09:53:19.019859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-AttachVolumeTestJSON-681977095 Jun 24 09:53:19.019859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-AttachVolumeTestJSON-681977095-project Jun 24 09:53:19.019859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:53:19.019859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:53:19.019859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: 3477f21462c84759b0762cf13427b3c8 Jun 24 09:53:19.019859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-AttachVolumeTestJSON-681977095-project Jun 24 09:53:19.019859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: > Jun 24 09:53:19.019859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Instance 17b90577-f77b-427f-89a9-a98e267d2183 could not be found. Jun 24 09:53:19.019859 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'id': '17b90577-f77b-427f-89a9-a98e267d2183'} Jun 24 09:53:19.021222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:53:19.021222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:19.021222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:53:19.021222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:53:19.021222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:53:19.021222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:53:19.021222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:53:19.021222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:53:19.021222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:53:19.021222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:53:19.021222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b90577-f77b-427f-89a9-a98e267d2183 could not be found. Jun 24 09:53:19.021222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:19.021222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:19.021222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:19.021222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:19.021222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:19.021222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:19.021222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:53:19.021222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:53:19.021222 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:53:19.023689 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:53:19.023689 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:53:19.023689 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:53:19.023689 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:53:19.023689 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:53:19.023689 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:53:19.023689 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:53:19.023689 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b90577-f77b-427f-89a9-a98e267d2183 could not be found. Jun 24 09:53:19.023689 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:19.023689 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:19.023689 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:19.023689 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:19.023689 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:19.023689 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:19.023689 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:53:19.023689 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:53:19.023689 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b90577-f77b-427f-89a9-a98e267d2183 could not be found. Jun 24 09:53:19.023689 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:19.025601 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-dddc5e78-fa29-458d-86ec-93845eda244b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Returning 404 to user: Instance 17b90577-f77b-427f-89a9-a98e267d2183 could not be found. {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:53:19.025601 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-dddc5e78-fa29-458d-86ec-93845eda244b tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183" status: 404 len: 111 microversion: 2.1 time: 0.039831 Jun 24 09:53:19.025601 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 505/1030] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:18 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:53:19.031174 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-6f77afc4-29bb-43b6-9749-784b7a41c143 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '.version_select at 0x7fc6d449e430>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:19.052521 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-6f77afc4-29bb-43b6-9749-784b7a41c143 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-935810863" status: 202 len: 0 microversion: 2.1 time: 0.025465 Jun 24 09:53:19.053080 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 526/1031] 10.222.0.65 () {58 vars in 1217 bytes} [Fri Jun 24 09:53:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-935810863 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:53:22.018256 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ee91cea2-46bb-4999-9607-71beb7d8569d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:22.018829 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ee91cea2-46bb-4999-9607-71beb7d8569d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:22.025857 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ee91cea2-46bb-4999-9607-71beb7d8569d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:22.026488 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ee91cea2-46bb-4999-9607-71beb7d8569d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:22.027309 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ee91cea2-46bb-4999-9607-71beb7d8569d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:22.027742 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ee91cea2-46bb-4999-9607-71beb7d8569d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:22.042219 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.wsgi [None req-ee91cea2-46bb-4999-9607-71beb7d8569d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] HTTP exception thrown: Instance 17b90577-f77b-427f-89a9-a98e267d2183 could not be found. Jun 24 09:53:22.043840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ee91cea2-46bb-4999-9607-71beb7d8569d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Request method failure captured: Jun 24 09:53:22.043840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: DELETE /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183 HTTP/1.1 Jun 24 09:53:22.043840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:53:22.043840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:53:22.043840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:53:22.043840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 0 Jun 24 09:53:22.043840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:53:22.043840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:53:22.043840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:53:22.043840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:53:22.043840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYigaj_ai9ZCtd1IPsoyIM3aZwQaxq_4zYiPV5tiqrQNTUM5jL0zuvOJJLIhUAQLcrT5lyoJRR5piqJAjuzLoOzIsIr3uBUYgSYViJydaauzIBIWF16GWl67WSJymfv6AIx8C8SLIqEP3guZY0k7DnhjHMsFMBH31MDp_90KswhzexE Jun 24 09:53:22.043840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:53:22.043840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:53:22.043840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:53:22.043840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:53:22.043840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:53:22.043840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:53:22.043840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: 9c90246f01ad410ea9569c51eb5f2ecb Jun 24 09:53:22.043840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-AttachVolumeTestJSON-681977095 Jun 24 09:53:22.043840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:53:22.043840 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:53:22.045534 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9c90246f01ad410ea9569c51eb5f2ecb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9c90246f01ad410ea9569c51eb5f2ecb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9c90246f01ad410ea9569c51eb5f2ecb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9c90246f01ad410ea9569c51eb5f2ecb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:53:22.045534 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-AttachVolumeTestJSON-681977095 Jun 24 09:53:22.045534 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: 9c90246f01ad410ea9569c51eb5f2ecb Jun 24 09:53:22.045534 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-AttachVolumeTestJSON-681977095 Jun 24 09:53:22.045534 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-AttachVolumeTestJSON-681977095-project Jun 24 09:53:22.045534 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:53:22.045534 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:53:22.045534 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: 3477f21462c84759b0762cf13427b3c8 Jun 24 09:53:22.045534 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-AttachVolumeTestJSON-681977095-project Jun 24 09:53:22.045534 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: > Jun 24 09:53:22.045534 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Instance 17b90577-f77b-427f-89a9-a98e267d2183 could not be found. Jun 24 09:53:22.045534 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'id': '17b90577-f77b-427f-89a9-a98e267d2183'} Jun 24 09:53:22.046573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:53:22.046573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:22.046573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:53:22.046573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:53:22.046573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:53:22.046573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:53:22.046573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:53:22.046573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:53:22.046573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:53:22.046573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:53:22.046573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b90577-f77b-427f-89a9-a98e267d2183 could not be found. Jun 24 09:53:22.046573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:22.046573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:22.046573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:22.046573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:22.046573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:22.046573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:22.046573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:53:22.046573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:53:22.046573 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:53:22.048085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:53:22.048085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 09:53:22.048085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 09:53:22.048085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 09:53:22.048085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 09:53:22.048085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:53:22.048085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:53:22.048085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:53:22.048085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:53:22.048085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b90577-f77b-427f-89a9-a98e267d2183 could not be found. Jun 24 09:53:22.048085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:22.048085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:22.048085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:22.048085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:22.048085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:22.048085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:22.048085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:53:22.048085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:53:22.048085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b90577-f77b-427f-89a9-a98e267d2183 could not be found. Jun 24 09:53:22.048085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:22.049606 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ee91cea2-46bb-4999-9607-71beb7d8569d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Returning 404 to user: Instance 17b90577-f77b-427f-89a9-a98e267d2183 could not be found. {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:53:22.049606 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ee91cea2-46bb-4999-9607-71beb7d8569d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "DELETE /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183" status: 404 len: 111 microversion: 2.1 time: 0.030913 Jun 24 09:53:22.049606 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 506/1032] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:53:22 2022] DELETE /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:53:22.054430 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-ddc83987-f67c-4e65-b76a-b94b9849d748 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:22.055201 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-ddc83987-f67c-4e65-b76a-b94b9849d748 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: 17b90577-f77b-427f-89a9-a98e267d2183] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:22.062338 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ddc83987-f67c-4e65-b76a-b94b9849d748 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:22.062780 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ddc83987-f67c-4e65-b76a-b94b9849d748 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:22.063577 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ddc83987-f67c-4e65-b76a-b94b9849d748 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:22.064010 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-ddc83987-f67c-4e65-b76a-b94b9849d748 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:22.078133 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-ddc83987-f67c-4e65-b76a-b94b9849d748 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] HTTP exception thrown: Instance 17b90577-f77b-427f-89a9-a98e267d2183 could not be found. Jun 24 09:53:22.079855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-ddc83987-f67c-4e65-b76a-b94b9849d748 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Request method failure captured: Jun 24 09:53:22.079855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183 HTTP/1.1 Jun 24 09:53:22.079855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:53:22.079855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:53:22.079855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:53:22.079855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:53:22.079855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:53:22.079855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:53:22.079855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:53:22.079855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:53:22.079855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYigaj_ai9ZCtd1IPsoyIM3aZwQaxq_4zYiPV5tiqrQNTUM5jL0zuvOJJLIhUAQLcrT5lyoJRR5piqJAjuzLoOzIsIr3uBUYgSYViJydaauzIBIWF16GWl67WSJymfv6AIx8C8SLIqEP3guZY0k7DnhjHMsFMBH31MDp_90KswhzexE Jun 24 09:53:22.079855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:53:22.079855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:53:22.079855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:53:22.079855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:53:22.079855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:53:22.079855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:53:22.079855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 9c90246f01ad410ea9569c51eb5f2ecb Jun 24 09:53:22.079855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-AttachVolumeTestJSON-681977095 Jun 24 09:53:22.079855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:53:22.079855 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:53:22.081427 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9c90246f01ad410ea9569c51eb5f2ecb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9c90246f01ad410ea9569c51eb5f2ecb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9c90246f01ad410ea9569c51eb5f2ecb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9c90246f01ad410ea9569c51eb5f2ecb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:53:22.081427 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-AttachVolumeTestJSON-681977095 Jun 24 09:53:22.081427 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 9c90246f01ad410ea9569c51eb5f2ecb Jun 24 09:53:22.081427 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-AttachVolumeTestJSON-681977095 Jun 24 09:53:22.081427 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-AttachVolumeTestJSON-681977095-project Jun 24 09:53:22.081427 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:53:22.081427 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:53:22.081427 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: 3477f21462c84759b0762cf13427b3c8 Jun 24 09:53:22.081427 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-AttachVolumeTestJSON-681977095-project Jun 24 09:53:22.081427 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:53:22.081427 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance 17b90577-f77b-427f-89a9-a98e267d2183 could not be found. Jun 24 09:53:22.081427 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': '17b90577-f77b-427f-89a9-a98e267d2183'} Jun 24 09:53:22.082377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:53:22.082377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:22.082377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:53:22.082377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:53:22.082377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:53:22.082377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:53:22.082377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:53:22.082377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:53:22.082377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:53:22.082377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:53:22.082377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b90577-f77b-427f-89a9-a98e267d2183 could not be found. Jun 24 09:53:22.082377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:22.082377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:22.082377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:22.082377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:22.082377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:22.082377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:22.082377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:53:22.082377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:53:22.082377 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:53:22.084482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:53:22.084482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:53:22.084482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:53:22.084482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:53:22.084482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:53:22.084482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:53:22.084482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:53:22.084482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b90577-f77b-427f-89a9-a98e267d2183 could not be found. Jun 24 09:53:22.084482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:22.084482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:22.084482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:22.084482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:22.084482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:22.084482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:22.084482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:53:22.084482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:53:22.084482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b90577-f77b-427f-89a9-a98e267d2183 could not be found. Jun 24 09:53:22.084482 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:22.086077 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-ddc83987-f67c-4e65-b76a-b94b9849d748 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Returning 404 to user: Instance 17b90577-f77b-427f-89a9-a98e267d2183 could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:53:22.086077 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-ddc83987-f67c-4e65-b76a-b94b9849d748 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183" status: 404 len: 111 microversion: 2.1 time: 0.031235 Jun 24 09:53:22.086077 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 527/1033] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:22 2022] GET /compute/v2.1/servers/17b90577-f77b-427f-89a9-a98e267d2183 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 09:53:23.233368 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-39f30b3f-efb8-440d-b895-d82e58f0705d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:23.233918 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-39f30b3f-efb8-440d-b895-d82e58f0705d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:23.241044 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-39f30b3f-efb8-440d-b895-d82e58f0705d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:23.241487 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-39f30b3f-efb8-440d-b895-d82e58f0705d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:23.242257 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-39f30b3f-efb8-440d-b895-d82e58f0705d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:23.242681 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-39f30b3f-efb8-440d-b895-d82e58f0705d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:23.257325 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.wsgi [None req-39f30b3f-efb8-440d-b895-d82e58f0705d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] HTTP exception thrown: Instance a5447c85-6da6-43c6-932d-51bd5ddb6577 could not be found. Jun 24 09:53:23.258897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-39f30b3f-efb8-440d-b895-d82e58f0705d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Request method failure captured: Jun 24 09:53:23.258897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: DELETE /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 HTTP/1.1 Jun 24 09:53:23.258897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:53:23.258897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:53:23.258897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:53:23.258897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 0 Jun 24 09:53:23.258897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:53:23.258897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:53:23.258897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:53:23.258897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:53:23.258897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYigaj_ai9ZCtd1IPsoyIM3aZwQaxq_4zYiPV5tiqrQNTUM5jL0zuvOJJLIhUAQLcrT5lyoJRR5piqJAjuzLoOzIsIr3uBUYgSYViJydaauzIBIWF16GWl67WSJymfv6AIx8C8SLIqEP3guZY0k7DnhjHMsFMBH31MDp_90KswhzexE Jun 24 09:53:23.258897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:53:23.258897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:53:23.258897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:53:23.258897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:53:23.258897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:53:23.258897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:53:23.258897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: 9c90246f01ad410ea9569c51eb5f2ecb Jun 24 09:53:23.258897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-AttachVolumeTestJSON-681977095 Jun 24 09:53:23.258897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:53:23.258897 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:53:23.260529 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9c90246f01ad410ea9569c51eb5f2ecb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9c90246f01ad410ea9569c51eb5f2ecb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9c90246f01ad410ea9569c51eb5f2ecb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9c90246f01ad410ea9569c51eb5f2ecb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:53:23.260529 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-AttachVolumeTestJSON-681977095 Jun 24 09:53:23.260529 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: 9c90246f01ad410ea9569c51eb5f2ecb Jun 24 09:53:23.260529 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-AttachVolumeTestJSON-681977095 Jun 24 09:53:23.260529 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-AttachVolumeTestJSON-681977095-project Jun 24 09:53:23.260529 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:53:23.260529 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:53:23.260529 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: 3477f21462c84759b0762cf13427b3c8 Jun 24 09:53:23.260529 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-AttachVolumeTestJSON-681977095-project Jun 24 09:53:23.260529 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: > Jun 24 09:53:23.260529 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Instance a5447c85-6da6-43c6-932d-51bd5ddb6577 could not be found. Jun 24 09:53:23.260529 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'id': 'a5447c85-6da6-43c6-932d-51bd5ddb6577'} Jun 24 09:53:23.262172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:53:23.262172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:23.262172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:53:23.262172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:53:23.262172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:53:23.262172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:53:23.262172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:53:23.262172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:53:23.262172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:53:23.262172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:53:23.262172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5447c85-6da6-43c6-932d-51bd5ddb6577 could not be found. Jun 24 09:53:23.262172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:23.262172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:23.262172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:23.262172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:23.262172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:23.262172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:23.262172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:53:23.262172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:53:23.262172 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:53:23.263489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:53:23.263489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 09:53:23.263489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 09:53:23.263489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 09:53:23.263489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 09:53:23.263489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:53:23.263489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:53:23.263489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:53:23.263489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:53:23.263489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5447c85-6da6-43c6-932d-51bd5ddb6577 could not be found. Jun 24 09:53:23.263489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:23.263489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:23.263489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:23.263489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:23.263489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:23.263489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:23.263489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:53:23.263489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:53:23.263489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5447c85-6da6-43c6-932d-51bd5ddb6577 could not be found. Jun 24 09:53:23.263489 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:23.264839 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-39f30b3f-efb8-440d-b895-d82e58f0705d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Returning 404 to user: Instance a5447c85-6da6-43c6-932d-51bd5ddb6577 could not be found. {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:53:23.264839 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-39f30b3f-efb8-440d-b895-d82e58f0705d tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 404 len: 111 microversion: 2.1 time: 0.031010 Jun 24 09:53:23.264839 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 507/1034] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:53:23 2022] DELETE /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:53:23.270495 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-5b0f4067-290d-458c-97f2-1bd2a6a42ff9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:23.272582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-5b0f4067-290d-458c-97f2-1bd2a6a42ff9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] [instance: a5447c85-6da6-43c6-932d-51bd5ddb6577] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:23.280644 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5b0f4067-290d-458c-97f2-1bd2a6a42ff9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:23.281092 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5b0f4067-290d-458c-97f2-1bd2a6a42ff9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:23.281879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5b0f4067-290d-458c-97f2-1bd2a6a42ff9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:23.282317 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-5b0f4067-290d-458c-97f2-1bd2a6a42ff9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:23.296770 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-5b0f4067-290d-458c-97f2-1bd2a6a42ff9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] HTTP exception thrown: Instance a5447c85-6da6-43c6-932d-51bd5ddb6577 could not be found. Jun 24 09:53:23.298341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-5b0f4067-290d-458c-97f2-1bd2a6a42ff9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Request method failure captured: Jun 24 09:53:23.298341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 HTTP/1.1 Jun 24 09:53:23.298341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:53:23.298341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:53:23.298341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:53:23.298341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:53:23.298341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:53:23.298341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:53:23.298341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:53:23.298341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:53:23.298341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYigaj_ai9ZCtd1IPsoyIM3aZwQaxq_4zYiPV5tiqrQNTUM5jL0zuvOJJLIhUAQLcrT5lyoJRR5piqJAjuzLoOzIsIr3uBUYgSYViJydaauzIBIWF16GWl67WSJymfv6AIx8C8SLIqEP3guZY0k7DnhjHMsFMBH31MDp_90KswhzexE Jun 24 09:53:23.298341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:53:23.298341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:53:23.298341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:53:23.298341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:53:23.298341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:53:23.298341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:53:23.298341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 9c90246f01ad410ea9569c51eb5f2ecb Jun 24 09:53:23.298341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-AttachVolumeTestJSON-681977095 Jun 24 09:53:23.298341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:53:23.298341 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:53:23.299881 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9c90246f01ad410ea9569c51eb5f2ecb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9c90246f01ad410ea9569c51eb5f2ecb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9c90246f01ad410ea9569c51eb5f2ecb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9c90246f01ad410ea9569c51eb5f2ecb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:53:23.299881 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-AttachVolumeTestJSON-681977095 Jun 24 09:53:23.299881 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 9c90246f01ad410ea9569c51eb5f2ecb Jun 24 09:53:23.299881 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-AttachVolumeTestJSON-681977095 Jun 24 09:53:23.299881 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-AttachVolumeTestJSON-681977095-project Jun 24 09:53:23.299881 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:53:23.299881 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:53:23.299881 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: 3477f21462c84759b0762cf13427b3c8 Jun 24 09:53:23.299881 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-AttachVolumeTestJSON-681977095-project Jun 24 09:53:23.299881 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:53:23.299881 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance a5447c85-6da6-43c6-932d-51bd5ddb6577 could not be found. Jun 24 09:53:23.299881 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': 'a5447c85-6da6-43c6-932d-51bd5ddb6577'} Jun 24 09:53:23.304363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:53:23.304363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:23.304363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:53:23.304363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:53:23.304363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:53:23.304363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:53:23.304363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:53:23.304363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:53:23.304363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:53:23.304363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:53:23.304363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5447c85-6da6-43c6-932d-51bd5ddb6577 could not be found. Jun 24 09:53:23.304363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:23.304363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:23.304363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:23.304363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:23.304363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:23.304363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:23.304363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:53:23.304363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:53:23.304363 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:53:23.305921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:53:23.305921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:53:23.305921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:53:23.305921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:53:23.305921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:53:23.305921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:53:23.305921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:53:23.305921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5447c85-6da6-43c6-932d-51bd5ddb6577 could not be found. Jun 24 09:53:23.305921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:23.305921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:23.305921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:23.305921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:23.305921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:23.305921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:23.305921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:53:23.305921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:53:23.305921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5447c85-6da6-43c6-932d-51bd5ddb6577 could not be found. Jun 24 09:53:23.305921 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:23.308387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-5b0f4067-290d-458c-97f2-1bd2a6a42ff9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] Returning 404 to user: Instance a5447c85-6da6-43c6-932d-51bd5ddb6577 could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:53:23.308387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-5b0f4067-290d-458c-97f2-1bd2a6a42ff9 tempest-AttachVolumeTestJSON-681977095 tempest-AttachVolumeTestJSON-681977095-project] 10.222.0.65 "GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577" status: 404 len: 111 microversion: 2.1 time: 0.034661 Jun 24 09:53:23.308387 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 528/1035] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:23 2022] GET /compute/v2.1/servers/a5447c85-6da6-43c6-932d-51bd5ddb6577 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:53:28.201425 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-76ad6c15-1701-49c7-90b9-c9a34e0dee46 tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] Action: 'create', calling method: .version_select at 0x7fc6d584cf70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2088091107", "metadata": {"Type": "work"}}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:53:28.226888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-76ad6c15-1701-49c7-90b9-c9a34e0dee46 tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] Request method failure captured: Jun 24 09:53:28.226888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 09:53:28.226888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:53:28.226888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:53:28.226888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:53:28.226888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 122 Jun 24 09:53:28.226888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:53:28.226888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:53:28.226888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:53:28.226888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:53:28.226888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYmXOtlYRB_ZAYbAYK36DwMo5aWxj7iN1GAC_d8Tlb-b1-vcZGtohlXyzER5DDTsXA4EVx0D-TZC9U3RQC4RRsjFehUWf7JeXU6tcDPSZupKny86T4NNEys7cXDCGJsiUNKWsmN-gyMISelPy2x39RwObOK4955KTPCMSnXPFRy8wO4 Jun 24 09:53:28.226888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:53:28.226888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:53:28.226888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:53:28.226888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:53:28.226888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:53:28.226888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:53:28.226888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: 749ebb5f332f43678afdf4f7af7012d1 Jun 24 09:53:28.226888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-VolumesNegativeTest-60682143 Jun 24 09:53:28.226888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:53:28.226888 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:53:28.228709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_749ebb5f332f43678afdf4f7af7012d1", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/749ebb5f332f43678afdf4f7af7012d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/749ebb5f332f43678afdf4f7af7012d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/749ebb5f332f43678afdf4f7af7012d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:53:28.228709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-VolumesNegativeTest-60682143 Jun 24 09:53:28.228709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: 749ebb5f332f43678afdf4f7af7012d1 Jun 24 09:53:28.228709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-VolumesNegativeTest-60682143 Jun 24 09:53:28.228709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-VolumesNegativeTest-60682143-project Jun 24 09:53:28.228709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:53:28.228709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:53:28.228709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: 1a3c52c97f3a448585fde2cb5bf5041b Jun 24 09:53:28.228709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-VolumesNegativeTest-60682143-project Jun 24 09:53:28.228709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Jun 24 09:53:28.228709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2088091107", "metadata": {"Type": "work"}}} Jun 24 09:53:28.228709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: Jun 24 09:53:28.228709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 09:53:28.229837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2088091107', 'metadata': {'Type': 'work'}}}} Jun 24 09:53:28.229837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:53:28.229837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:28.229837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 09:53:28.229837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 09:53:28.229837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 09:53:28.229837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise error Jun 24 09:53:28.229837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 24 09:53:28.229837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.229837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 24 09:53:28.229837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 09:53:28.229837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.229837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 09:53:28.229837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi '#$%' Jun 24 09:53:28.229837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.229837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:28.229837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.229837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:28.229837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:28.229837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:28.229837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:53:28.229837 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:53:28.232203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 09:53:28.232203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 09:53:28.232203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:53:28.232203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:53:28.232203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 09:53:28.232203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 09:53:28.232203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 09:53:28.232203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 09:53:28.232203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 09:53:28.232203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 09:53:28.232203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 09:53:28.232203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.232203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:28.232203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.232203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:28.232203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:28.232203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:28.232203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 09:53:28.232203 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 09:53:28.233556 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 09:53:28.233556 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.233556 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-76ad6c15-1701-49c7-90b9-c9a34e0dee46 tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:53:28.233556 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-76ad6c15-1701-49c7-90b9-c9a34e0dee46 tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.162101 Jun 24 09:53:28.233556 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 508/1036] 10.222.0.65 () {60 vars in 1155 bytes} [Fri Jun 24 09:53:28 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 09:53:28.239465 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a1e919a7-4ddb-4fdd-9698-8eaf1719fca1 tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] Action: 'create', calling method: .version_select at 0x7fc6d71228b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1437315907", "metadata": {"Type": "work"}}} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:53:28.242690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a1e919a7-4ddb-4fdd-9698-8eaf1719fca1 tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] Request method failure captured: Jun 24 09:53:28.242690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 09:53:28.242690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:53:28.242690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:53:28.242690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:53:28.242690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 120 Jun 24 09:53:28.242690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:53:28.242690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:53:28.242690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:53:28.242690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:53:28.242690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYmXOtlYRB_ZAYbAYK36DwMo5aWxj7iN1GAC_d8Tlb-b1-vcZGtohlXyzER5DDTsXA4EVx0D-TZC9U3RQC4RRsjFehUWf7JeXU6tcDPSZupKny86T4NNEys7cXDCGJsiUNKWsmN-gyMISelPy2x39RwObOK4955KTPCMSnXPFRy8wO4 Jun 24 09:53:28.242690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:53:28.242690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:53:28.242690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:53:28.242690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:53:28.242690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:53:28.242690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:53:28.242690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 749ebb5f332f43678afdf4f7af7012d1 Jun 24 09:53:28.242690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-VolumesNegativeTest-60682143 Jun 24 09:53:28.242690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:53:28.242690 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:53:28.244499 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_749ebb5f332f43678afdf4f7af7012d1", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/749ebb5f332f43678afdf4f7af7012d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/749ebb5f332f43678afdf4f7af7012d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/749ebb5f332f43678afdf4f7af7012d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:53:28.244499 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-VolumesNegativeTest-60682143 Jun 24 09:53:28.244499 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 749ebb5f332f43678afdf4f7af7012d1 Jun 24 09:53:28.244499 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-VolumesNegativeTest-60682143 Jun 24 09:53:28.244499 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-VolumesNegativeTest-60682143-project Jun 24 09:53:28.244499 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:53:28.244499 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:53:28.244499 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: 1a3c52c97f3a448585fde2cb5bf5041b Jun 24 09:53:28.244499 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-VolumesNegativeTest-60682143-project Jun 24 09:53:28.244499 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Jun 24 09:53:28.244499 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1437315907", "metadata": {"Type": "work"}}} Jun 24 09:53:28.244499 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: Jun 24 09:53:28.244499 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 09:53:28.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1437315907', 'metadata': {'Type': 'work'}}}} Jun 24 09:53:28.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:53:28.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:28.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 09:53:28.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 09:53:28.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 09:53:28.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise error Jun 24 09:53:28.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 24 09:53:28.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 24 09:53:28.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 09:53:28.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 09:53:28.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi '0' Jun 24 09:53:28.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:28.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:28.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:28.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:28.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:53:28.245386 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:53:28.246800 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 09:53:28.246800 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 09:53:28.246800 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:53:28.246800 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:53:28.246800 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 09:53:28.246800 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 09:53:28.246800 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 09:53:28.246800 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 09:53:28.246800 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 09:53:28.246800 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 09:53:28.246800 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 09:53:28.246800 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.246800 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:28.246800 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.246800 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:28.246800 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:28.246800 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:28.246800 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 09:53:28.246800 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 09:53:28.248044 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 09:53:28.248044 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.248044 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a1e919a7-4ddb-4fdd-9698-8eaf1719fca1 tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:53:28.248044 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-a1e919a7-4ddb-4fdd-9698-8eaf1719fca1 tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008867 Jun 24 09:53:28.248044 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 529/1037] 10.222.0.65 () {60 vars in 1155 bytes} [Fri Jun 24 09:53:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 09:53:28.256111 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7d1786c5-c753-4414-9380-3a110bf917f6 tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] Action: 'create', calling method: .version_select at 0x7fc6d4e33940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-721634927", "metadata": {"Type": "work"}}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:53:28.259427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7d1786c5-c753-4414-9380-3a110bf917f6 tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] Request method failure captured: Jun 24 09:53:28.259427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 09:53:28.259427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:53:28.259427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:53:28.259427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:53:28.259427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 118 Jun 24 09:53:28.259427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:53:28.259427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:53:28.259427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:53:28.259427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:53:28.259427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYmXOtlYRB_ZAYbAYK36DwMo5aWxj7iN1GAC_d8Tlb-b1-vcZGtohlXyzER5DDTsXA4EVx0D-TZC9U3RQC4RRsjFehUWf7JeXU6tcDPSZupKny86T4NNEys7cXDCGJsiUNKWsmN-gyMISelPy2x39RwObOK4955KTPCMSnXPFRy8wO4 Jun 24 09:53:28.259427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:53:28.259427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:53:28.259427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:53:28.259427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:53:28.259427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:53:28.259427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:53:28.259427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: 749ebb5f332f43678afdf4f7af7012d1 Jun 24 09:53:28.259427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-VolumesNegativeTest-60682143 Jun 24 09:53:28.259427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:53:28.259427 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:53:28.261005 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_749ebb5f332f43678afdf4f7af7012d1", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/749ebb5f332f43678afdf4f7af7012d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/749ebb5f332f43678afdf4f7af7012d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/749ebb5f332f43678afdf4f7af7012d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:53:28.261005 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-VolumesNegativeTest-60682143 Jun 24 09:53:28.261005 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: 749ebb5f332f43678afdf4f7af7012d1 Jun 24 09:53:28.261005 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-VolumesNegativeTest-60682143 Jun 24 09:53:28.261005 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-VolumesNegativeTest-60682143-project Jun 24 09:53:28.261005 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:53:28.261005 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:53:28.261005 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: 1a3c52c97f3a448585fde2cb5bf5041b Jun 24 09:53:28.261005 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-VolumesNegativeTest-60682143-project Jun 24 09:53:28.261005 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Jun 24 09:53:28.261005 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-721634927", "metadata": {"Type": "work"}}} Jun 24 09:53:28.261005 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: Jun 24 09:53:28.261005 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 09:53:28.262313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-721634927', 'metadata': {'Type': 'work'}}}} Jun 24 09:53:28.262313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:53:28.262313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:28.262313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 09:53:28.262313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 09:53:28.262313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 09:53:28.262313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise error Jun 24 09:53:28.262313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 24 09:53:28.262313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.262313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 24 09:53:28.262313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 09:53:28.262313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.262313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 09:53:28.262313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi '' Jun 24 09:53:28.262313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.262313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:28.262313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.262313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:28.262313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:28.262313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:28.262313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:53:28.262313 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:53:28.264073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 09:53:28.264073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 09:53:28.264073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:53:28.264073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:53:28.264073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 09:53:28.264073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 09:53:28.264073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 09:53:28.264073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 09:53:28.264073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 09:53:28.264073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 09:53:28.264073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 09:53:28.264073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.264073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:28.264073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.264073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:28.264073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:28.264073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:28.264073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 09:53:28.264073 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 09:53:28.265812 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 09:53:28.265812 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.265812 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-7d1786c5-c753-4414-9380-3a110bf917f6 tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:53:28.265812 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-7d1786c5-c753-4414-9380-3a110bf917f6 tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008639 Jun 24 09:53:28.265812 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 509/1038] 10.222.0.65 () {60 vars in 1155 bytes} [Fri Jun 24 09:53:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 09:53:28.273323 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7c585691-945e-409a-94f6-05903b6d0763 tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] Calling method '.version_select at 0x7fc6d44ac5e0>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:28.304616 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-7c585691-945e-409a-94f6-05903b6d0763 tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] HTTP exception thrown: Volume tempest-invalid-1382746952 could not be found. Jun 24 09:53:28.306697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7c585691-945e-409a-94f6-05903b6d0763 tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] Request method failure captured: Jun 24 09:53:28.306697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1382746952 HTTP/1.1 Jun 24 09:53:28.306697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:53:28.306697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:53:28.306697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:53:28.306697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:53:28.306697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:53:28.306697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:53:28.306697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:53:28.306697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:53:28.306697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYmXOtlYRB_ZAYbAYK36DwMo5aWxj7iN1GAC_d8Tlb-b1-vcZGtohlXyzER5DDTsXA4EVx0D-TZC9U3RQC4RRsjFehUWf7JeXU6tcDPSZupKny86T4NNEys7cXDCGJsiUNKWsmN-gyMISelPy2x39RwObOK4955KTPCMSnXPFRy8wO4 Jun 24 09:53:28.306697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:53:28.306697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:53:28.306697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:53:28.306697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:53:28.306697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:53:28.306697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:53:28.306697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 749ebb5f332f43678afdf4f7af7012d1 Jun 24 09:53:28.306697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-VolumesNegativeTest-60682143 Jun 24 09:53:28.306697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:53:28.306697 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:53:28.308291 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_749ebb5f332f43678afdf4f7af7012d1", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/749ebb5f332f43678afdf4f7af7012d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/749ebb5f332f43678afdf4f7af7012d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/749ebb5f332f43678afdf4f7af7012d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:53:28.308291 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-VolumesNegativeTest-60682143 Jun 24 09:53:28.308291 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 749ebb5f332f43678afdf4f7af7012d1 Jun 24 09:53:28.308291 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-VolumesNegativeTest-60682143 Jun 24 09:53:28.308291 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-VolumesNegativeTest-60682143-project Jun 24 09:53:28.308291 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:53:28.308291 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:53:28.308291 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: 1a3c52c97f3a448585fde2cb5bf5041b Jun 24 09:53:28.308291 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-VolumesNegativeTest-60682143-project Jun 24 09:53:28.308291 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: Jun 24 09:53:28.308291 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Volume tempest-invalid-1382746952 could not be found. Jun 24 09:53:28.308291 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': 'tempest-invalid-1382746952'} Jun 24 09:53:28.308291 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:53:28.308291 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:28.309263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:53:28.309263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:53:28.309263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 09:53:28.309263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 09:53:28.309263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 09:53:28.309263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 09:53:28.309263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 09:53:28.309263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 09:53:28.309263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 09:53:28.309263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 09:53:28.309263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:53:28.309263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:53:28.309263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:53:28.309263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:53:28.309263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1382746952 could not be found. (HTTP 404) (Request-ID: req-dc355843-a2a1-46c2-8931-7b88c450b3cc) Jun 24 09:53:28.309263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.309263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:28.309263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.309263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:28.310740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 09:53:28.310740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 09:53:28.310740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:53:28.310740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:53:28.310740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 09:53:28.310740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 09:53:28.310740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:53:28.310740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:53:28.310740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:53:28.310740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:53:28.310740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 09:53:28.310740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 09:53:28.310740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 09:53:28.310740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 09:53:28.310740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 09:53:28.310740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 09:53:28.310740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 09:53:28.310740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 09:53:28.312273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:53:28.312273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:53:28.312273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:53:28.312273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:53:28.312273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1382746952 could not be found. Jun 24 09:53:28.312273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.312273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:28.312273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.312273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:28.312273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:28.312273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:28.312273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:53:28.312273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:53:28.312273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 09:53:28.312273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 09:53:28.312273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:53:28.312273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:53:28.312273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 09:53:28.312273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:53:28.312273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1382746952 could not be found. Jun 24 09:53:28.314065 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.314065 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:28.314065 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.314065 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:28.314065 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:28.314065 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:28.314065 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:53:28.314065 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:53:28.314065 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1382746952 could not be found. Jun 24 09:53:28.314065 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.314065 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-7c585691-945e-409a-94f6-05903b6d0763 tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] Returning 404 to user: Volume tempest-invalid-1382746952 could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:53:28.314065 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-7c585691-945e-409a-94f6-05903b6d0763 tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1382746952" status: 404 len: 99 microversion: 2.1 time: 0.040445 Jun 24 09:53:28.314065 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 530/1039] 10.222.0.65 () {58 vars in 1217 bytes} [Fri Jun 24 09:53:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1382746952 => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 24 09:53:28.319819 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ede4d9b0-2d63-4a9b-abf9-2923f6db411d tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004038 Jun 24 09:53:28.320319 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 510/1040] 10.222.0.65 () {58 vars in 1139 bytes} [Fri Jun 24 09:53:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 24 09:53:28.330288 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-cad2befd-6435-4b32-ae81-618c72cc3b85 tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003893 Jun 24 09:53:28.330787 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 531/1041] 10.222.0.65 () {58 vars in 1136 bytes} [Fri Jun 24 09:53:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 24 09:53:28.341011 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-95c30fc8-0844-4025-8f03-e08825cf6c8e tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] Calling method '.version_select at 0x7fc6d4f51f70>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:28.371625 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.wsgi [None req-95c30fc8-0844-4025-8f03-e08825cf6c8e tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] HTTP exception thrown: Volume 16ca3490-f958-402a-a8d2-12d79189cf36 could not be found. Jun 24 09:53:28.373772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-95c30fc8-0844-4025-8f03-e08825cf6c8e tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] Request method failure captured: Jun 24 09:53:28.373772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: DELETE /compute/v2.1/os-volumes/16ca3490-f958-402a-a8d2-12d79189cf36 HTTP/1.1 Jun 24 09:53:28.373772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:53:28.373772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:53:28.373772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:53:28.373772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 0 Jun 24 09:53:28.373772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:53:28.373772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:53:28.373772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:53:28.373772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:53:28.373772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYmXOtlYRB_ZAYbAYK36DwMo5aWxj7iN1GAC_d8Tlb-b1-vcZGtohlXyzER5DDTsXA4EVx0D-TZC9U3RQC4RRsjFehUWf7JeXU6tcDPSZupKny86T4NNEys7cXDCGJsiUNKWsmN-gyMISelPy2x39RwObOK4955KTPCMSnXPFRy8wO4 Jun 24 09:53:28.373772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:53:28.373772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:53:28.373772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:53:28.373772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:53:28.373772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:53:28.373772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:53:28.373772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: 749ebb5f332f43678afdf4f7af7012d1 Jun 24 09:53:28.373772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-VolumesNegativeTest-60682143 Jun 24 09:53:28.373772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:53:28.373772 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:53:28.375479 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_749ebb5f332f43678afdf4f7af7012d1", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/749ebb5f332f43678afdf4f7af7012d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/749ebb5f332f43678afdf4f7af7012d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/749ebb5f332f43678afdf4f7af7012d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:53:28.375479 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-VolumesNegativeTest-60682143 Jun 24 09:53:28.375479 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: 749ebb5f332f43678afdf4f7af7012d1 Jun 24 09:53:28.375479 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-VolumesNegativeTest-60682143 Jun 24 09:53:28.375479 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-VolumesNegativeTest-60682143-project Jun 24 09:53:28.375479 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:53:28.375479 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:53:28.375479 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: 1a3c52c97f3a448585fde2cb5bf5041b Jun 24 09:53:28.375479 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-VolumesNegativeTest-60682143-project Jun 24 09:53:28.375479 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: Jun 24 09:53:28.375479 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Volume 16ca3490-f958-402a-a8d2-12d79189cf36 could not be found. Jun 24 09:53:28.375479 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'id': '16ca3490-f958-402a-a8d2-12d79189cf36'} Jun 24 09:53:28.375479 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:53:28.376523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:28.376523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:53:28.376523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:53:28.376523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 09:53:28.376523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 09:53:28.376523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 09:53:28.376523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 09:53:28.376523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 09:53:28.376523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 09:53:28.376523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 09:53:28.376523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 09:53:28.376523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:53:28.376523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:53:28.376523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:53:28.376523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:53:28.376523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 16ca3490-f958-402a-a8d2-12d79189cf36 could not be found. (HTTP 404) (Request-ID: req-86eda6f9-fc8b-418f-9547-6ada626a6a3c) Jun 24 09:53:28.376523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.376523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:28.376523 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.377969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:28.377969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 09:53:28.377969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 09:53:28.377969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:53:28.377969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:53:28.377969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 09:53:28.377969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 09:53:28.377969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:53:28.377969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:53:28.377969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:53:28.377969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:53:28.377969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 09:53:28.377969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 09:53:28.377969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 09:53:28.377969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 09:53:28.377969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 09:53:28.377969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 09:53:28.377969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 09:53:28.377969 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 09:53:28.379264 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:53:28.379264 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:53:28.379264 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:53:28.379264 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:53:28.379264 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 16ca3490-f958-402a-a8d2-12d79189cf36 could not be found. Jun 24 09:53:28.379264 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.379264 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:28.379264 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.379264 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:28.379264 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:28.379264 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:28.379264 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:53:28.379264 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:53:28.379264 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 09:53:28.379264 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 09:53:28.379264 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:53:28.379264 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:53:28.379264 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 09:53:28.379264 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:53:28.380657 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 16ca3490-f958-402a-a8d2-12d79189cf36 could not be found. Jun 24 09:53:28.380657 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.380657 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:28.380657 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.380657 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:28.380657 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:28.380657 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:28.380657 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:53:28.380657 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:53:28.380657 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 16ca3490-f958-402a-a8d2-12d79189cf36 could not be found. Jun 24 09:53:28.380657 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.380657 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-95c30fc8-0844-4025-8f03-e08825cf6c8e tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] Returning 404 to user: Volume 16ca3490-f958-402a-a8d2-12d79189cf36 could not be found. {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:53:28.380657 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-95c30fc8-0844-4025-8f03-e08825cf6c8e tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/16ca3490-f958-402a-a8d2-12d79189cf36" status: 404 len: 109 microversion: 2.1 time: 0.038663 Jun 24 09:53:28.380657 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 511/1042] 10.222.0.65 () {58 vars in 1247 bytes} [Fri Jun 24 09:53:28 2022] DELETE /compute/v2.1/os-volumes/16ca3490-f958-402a-a8d2-12d79189cf36 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:53:28.385223 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-8ea80cf0-1f37-49f8-8fb4-151224732e0b tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] Calling method '.version_select at 0x7fc6d44d5af0>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:28.413740 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-8ea80cf0-1f37-49f8-8fb4-151224732e0b tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] HTTP exception thrown: Volume e23e0c2d-7607-4a85-ad6f-8614b3419125 could not be found. Jun 24 09:53:28.415879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-8ea80cf0-1f37-49f8-8fb4-151224732e0b tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] Request method failure captured: Jun 24 09:53:28.415879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/os-volumes/e23e0c2d-7607-4a85-ad6f-8614b3419125 HTTP/1.1 Jun 24 09:53:28.415879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:53:28.415879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:53:28.415879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:53:28.415879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:53:28.415879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:53:28.415879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:53:28.415879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:53:28.415879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:53:28.415879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYmXOtlYRB_ZAYbAYK36DwMo5aWxj7iN1GAC_d8Tlb-b1-vcZGtohlXyzER5DDTsXA4EVx0D-TZC9U3RQC4RRsjFehUWf7JeXU6tcDPSZupKny86T4NNEys7cXDCGJsiUNKWsmN-gyMISelPy2x39RwObOK4955KTPCMSnXPFRy8wO4 Jun 24 09:53:28.415879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:53:28.415879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:53:28.415879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:53:28.415879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:53:28.415879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:53:28.415879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:53:28.415879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 749ebb5f332f43678afdf4f7af7012d1 Jun 24 09:53:28.415879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-VolumesNegativeTest-60682143 Jun 24 09:53:28.415879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:53:28.415879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:53:28.417436 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_749ebb5f332f43678afdf4f7af7012d1", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/749ebb5f332f43678afdf4f7af7012d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/749ebb5f332f43678afdf4f7af7012d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/749ebb5f332f43678afdf4f7af7012d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:53:28.417436 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-VolumesNegativeTest-60682143 Jun 24 09:53:28.417436 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 749ebb5f332f43678afdf4f7af7012d1 Jun 24 09:53:28.417436 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-VolumesNegativeTest-60682143 Jun 24 09:53:28.417436 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-VolumesNegativeTest-60682143-project Jun 24 09:53:28.417436 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:53:28.417436 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:53:28.417436 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: 1a3c52c97f3a448585fde2cb5bf5041b Jun 24 09:53:28.417436 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-VolumesNegativeTest-60682143-project Jun 24 09:53:28.417436 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: Jun 24 09:53:28.417436 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Volume e23e0c2d-7607-4a85-ad6f-8614b3419125 could not be found. Jun 24 09:53:28.417436 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': 'e23e0c2d-7607-4a85-ad6f-8614b3419125'} Jun 24 09:53:28.417436 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:53:28.418582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:28.418582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:53:28.418582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:53:28.418582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 09:53:28.418582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 09:53:28.418582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 09:53:28.418582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 09:53:28.418582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 09:53:28.418582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 09:53:28.418582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 09:53:28.418582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 09:53:28.418582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:53:28.418582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:53:28.418582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:53:28.418582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:53:28.418582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e23e0c2d-7607-4a85-ad6f-8614b3419125 could not be found. (HTTP 404) (Request-ID: req-b519e6b8-22ed-4ec5-8f32-45274ecd4af1) Jun 24 09:53:28.418582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.418582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:28.418582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.420250 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:28.420250 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 09:53:28.420250 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 09:53:28.420250 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:53:28.420250 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:53:28.420250 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 09:53:28.420250 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 09:53:28.420250 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:53:28.420250 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:53:28.420250 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:53:28.420250 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:53:28.420250 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 09:53:28.420250 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 09:53:28.420250 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 09:53:28.420250 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 09:53:28.420250 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 09:53:28.420250 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 09:53:28.420250 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 09:53:28.420250 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 09:53:28.421990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:53:28.421990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:53:28.421990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:53:28.421990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:53:28.421990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e23e0c2d-7607-4a85-ad6f-8614b3419125 could not be found. Jun 24 09:53:28.421990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.421990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:28.421990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.421990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:28.421990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:28.421990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:28.421990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:53:28.421990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:53:28.421990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 09:53:28.421990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 09:53:28.421990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:53:28.421990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:53:28.421990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 09:53:28.421990 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:53:28.423458 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e23e0c2d-7607-4a85-ad6f-8614b3419125 could not be found. Jun 24 09:53:28.423458 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.423458 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:28.423458 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.423458 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:28.423458 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:28.423458 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:28.423458 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:53:28.423458 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:53:28.423458 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e23e0c2d-7607-4a85-ad6f-8614b3419125 could not be found. Jun 24 09:53:28.423458 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:53:28.423458 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-8ea80cf0-1f37-49f8-8fb4-151224732e0b tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] Returning 404 to user: Volume e23e0c2d-7607-4a85-ad6f-8614b3419125 could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:53:28.423458 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-8ea80cf0-1f37-49f8-8fb4-151224732e0b tempest-VolumesNegativeTest-60682143 tempest-VolumesNegativeTest-60682143-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/e23e0c2d-7607-4a85-ad6f-8614b3419125" status: 404 len: 109 microversion: 2.1 time: 0.036031 Jun 24 09:53:28.423458 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 532/1043] 10.222.0.65 () {58 vars in 1244 bytes} [Fri Jun 24 09:53:28 2022] GET /compute/v2.1/os-volumes/e23e0c2d-7607-4a85-ad6f-8614b3419125 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:53:39.253652 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=22 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:39.254425 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:39.259167 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-fa311975-8d7d-4404-8da7-b2658ab47487 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1916446611", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-853348123", "security_groups": [{"name": "tempest-secgroup-smoke-2012499460"}], "block_device_mapping_v2": [{"uuid": "3350a45b-f29a-4ca8-b3f7-8e126e13a689", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d67d849c-d27d-4bea-a085-4b945957c857"}]}} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:53:39.377807 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.network.neutron [None req-fa311975-8d7d-4404-8da7-b2658ab47487 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] validate_networks() for [('d67d849c-d27d-4bea-a085-4b945957c857', None, None, None, None, None)] {{(pid=124338) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:53:39.878126 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-fa311975-8d7d-4404-8da7-b2658ab47487 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Flavor limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:53:39.878558 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-fa311975-8d7d-4404-8da7-b2658ab47487 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Image limits 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:53:39.879015 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-fa311975-8d7d-4404-8da7-b2658ab47487 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Flavor pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:53:39.879449 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-fa311975-8d7d-4404-8da7-b2658ab47487 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Image pref 0:0:0 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:53:39.879860 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.virt.hardware [None req-fa311975-8d7d-4404-8da7-b2658ab47487 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:53:39.889086 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fa311975-8d7d-4404-8da7-b2658ab47487 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:39.889764 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fa311975-8d7d-4404-8da7-b2658ab47487 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:39.890595 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fa311975-8d7d-4404-8da7-b2658ab47487 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:39.891031 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-fa311975-8d7d-4404-8da7-b2658ab47487 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:39.910256 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-fa311975-8d7d-4404-8da7-b2658ab47487 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Getting quotas for project 86f042cb88b7426ea9733f70033b55e3. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:53:39.915019 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.quota [None req-fa311975-8d7d-4404-8da7-b2658ab47487 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Getting quotas for user 565cc9705a94454b9e68595b85c6a286 and project 86f042cb88b7426ea9733f70033b55e3. Resources: {'cores', 'ram', 'instances'} {{(pid=124338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:53:39.981547 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-fa311975-8d7d-4404-8da7-b2658ab47487 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Going to run 1 instances... {{(pid=124338) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:53:39.983919 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-fa311975-8d7d-4404-8da7-b2658ab47487 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 3e21a450-afb9-4139-8fa8-6804a81e88e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3350a45b-f29a-4ca8-b3f7-8e126e13a689',volume_size=None,volume_type=None)] {{(pid=124338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:53:40.126668 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-fa311975-8d7d-4404-8da7-b2658ab47487 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.874354 Jun 24 09:53:40.127486 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 512/1044] 10.222.0.65 () {60 vars in 1146 bytes} [Fri Jun 24 09:53:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 09:53:40.135797 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:40.137428 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:40.141952 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-1cf033e3-6778-4ca6-9ba0-5e7a48a517f8 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:40.143263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-1cf033e3-6778-4ca6-9ba0-5e7a48a517f8 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 3e21a450-afb9-4139-8fa8-6804a81e88e9] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:40.220149 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-1cf033e3-6778-4ca6-9ba0-5e7a48a517f8 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:53:40.227699 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-1cf033e3-6778-4ca6-9ba0-5e7a48a517f8 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9" status: 200 len: 1094 microversion: 2.1 time: 0.094054 Jun 24 09:53:40.228296 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 533/1045] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:40 2022] GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9 => generated 1094 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:41.246234 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-588350e9-e097-4c9d-871f-15240f0dd288 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:41.246830 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-588350e9-e097-4c9d-871f-15240f0dd288 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 3e21a450-afb9-4139-8fa8-6804a81e88e9] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:41.255925 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-588350e9-e097-4c9d-871f-15240f0dd288 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:41.256507 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-588350e9-e097-4c9d-871f-15240f0dd288 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:41.257373 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-588350e9-e097-4c9d-871f-15240f0dd288 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:41.258019 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-588350e9-e097-4c9d-871f-15240f0dd288 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:41.357600 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-588350e9-e097-4c9d-871f-15240f0dd288 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:53:41.366006 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-588350e9-e097-4c9d-871f-15240f0dd288 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9" status: 200 len: 1210 microversion: 2.1 time: 0.125075 Jun 24 09:53:41.366608 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 513/1046] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:41 2022] GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9 => generated 1210 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:42.383766 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-8cfd02fd-af27-4f7d-a124-6ae7089b6fef tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:42.384942 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-8cfd02fd-af27-4f7d-a124-6ae7089b6fef tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 3e21a450-afb9-4139-8fa8-6804a81e88e9] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:42.392765 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8cfd02fd-af27-4f7d-a124-6ae7089b6fef tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:42.393834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8cfd02fd-af27-4f7d-a124-6ae7089b6fef tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:42.394648 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8cfd02fd-af27-4f7d-a124-6ae7089b6fef tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:42.395129 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8cfd02fd-af27-4f7d-a124-6ae7089b6fef tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:42.687824 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-8cfd02fd-af27-4f7d-a124-6ae7089b6fef tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:53:42.696870 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-8cfd02fd-af27-4f7d-a124-6ae7089b6fef tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9" status: 200 len: 1266 microversion: 2.1 time: 0.317314 Jun 24 09:53:42.698191 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 534/1047] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:42 2022] GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9 => generated 1266 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:42.854629 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-419c1705-2b53-45ae-ab7f-62f5d2636079 req-b493dde6-77c0-4b7e-8bd4-15c1cbb7fb4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e21a450-afb9-4139-8fa8-6804a81e88e9", "tag": "ea03aaee-bcb4-4032-971d-c78ce5352beb"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:53:42.873504 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-419c1705-2b53-45ae-ab7f-62f5d2636079 req-b493dde6-77c0-4b7e-8bd4-15c1cbb7fb4a service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:42.874029 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-419c1705-2b53-45ae-ab7f-62f5d2636079 req-b493dde6-77c0-4b7e-8bd4-15c1cbb7fb4a service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:42.888626 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-419c1705-2b53-45ae-ab7f-62f5d2636079 req-b493dde6-77c0-4b7e-8bd4-15c1cbb7fb4a service nova] Creating event network-changed:ea03aaee-bcb4-4032-971d-c78ce5352beb for instance 3e21a450-afb9-4139-8fa8-6804a81e88e9 on hv-cinder-80382 Jun 24 09:53:42.895687 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-419c1705-2b53-45ae-ab7f-62f5d2636079 req-b493dde6-77c0-4b7e-8bd4-15c1cbb7fb4a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047111 Jun 24 09:53:42.896981 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 514/1048] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:53:43.715251 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3660fc9f-9fcf-409d-b0c6-45f8c1791d93 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:43.716495 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3660fc9f-9fcf-409d-b0c6-45f8c1791d93 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 3e21a450-afb9-4139-8fa8-6804a81e88e9] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:43.723273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3660fc9f-9fcf-409d-b0c6-45f8c1791d93 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:43.724000 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3660fc9f-9fcf-409d-b0c6-45f8c1791d93 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:43.724787 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3660fc9f-9fcf-409d-b0c6-45f8c1791d93 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:43.725218 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3660fc9f-9fcf-409d-b0c6-45f8c1791d93 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:43.933182 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3660fc9f-9fcf-409d-b0c6-45f8c1791d93 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:53:43.941915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3660fc9f-9fcf-409d-b0c6-45f8c1791d93 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9" status: 200 len: 1266 microversion: 2.1 time: 0.229894 Jun 24 09:53:43.941915 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 535/1049] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:43 2022] GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:44.960139 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-5f8c1735-cc9d-454d-a598-9c5ce3b3d042 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:44.960848 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-5f8c1735-cc9d-454d-a598-9c5ce3b3d042 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 3e21a450-afb9-4139-8fa8-6804a81e88e9] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:44.968516 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5f8c1735-cc9d-454d-a598-9c5ce3b3d042 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:44.969428 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5f8c1735-cc9d-454d-a598-9c5ce3b3d042 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:44.970496 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5f8c1735-cc9d-454d-a598-9c5ce3b3d042 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:44.971016 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-5f8c1735-cc9d-454d-a598-9c5ce3b3d042 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:45.112201 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-5f8c1735-cc9d-454d-a598-9c5ce3b3d042 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:53:45.120017 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-5f8c1735-cc9d-454d-a598-9c5ce3b3d042 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9" status: 200 len: 1266 microversion: 2.1 time: 0.165004 Jun 24 09:53:45.120601 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 515/1050] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:44 2022] GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:46.138678 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-c98485e9-9bb1-479c-8cb5-6b454a9c0c71 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:46.139467 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-c98485e9-9bb1-479c-8cb5-6b454a9c0c71 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 3e21a450-afb9-4139-8fa8-6804a81e88e9] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:46.146659 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c98485e9-9bb1-479c-8cb5-6b454a9c0c71 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:46.147108 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c98485e9-9bb1-479c-8cb5-6b454a9c0c71 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:46.147924 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c98485e9-9bb1-479c-8cb5-6b454a9c0c71 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:46.148361 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-c98485e9-9bb1-479c-8cb5-6b454a9c0c71 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:46.474486 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-c98485e9-9bb1-479c-8cb5-6b454a9c0c71 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:53:46.482765 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-c98485e9-9bb1-479c-8cb5-6b454a9c0c71 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9" status: 200 len: 1266 microversion: 2.1 time: 0.348716 Jun 24 09:53:46.483383 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 536/1051] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:46 2022] GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9 => generated 1266 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:47.500646 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-87d1c0d8-522a-4ab4-83e9-b5806fe68bea tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:47.501365 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-87d1c0d8-522a-4ab4-83e9-b5806fe68bea tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 3e21a450-afb9-4139-8fa8-6804a81e88e9] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:47.508610 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-87d1c0d8-522a-4ab4-83e9-b5806fe68bea tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:47.509056 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-87d1c0d8-522a-4ab4-83e9-b5806fe68bea tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:47.509836 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-87d1c0d8-522a-4ab4-83e9-b5806fe68bea tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:47.510300 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-87d1c0d8-522a-4ab4-83e9-b5806fe68bea tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:47.666080 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-87d1c0d8-522a-4ab4-83e9-b5806fe68bea tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:53:47.675452 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-87d1c0d8-522a-4ab4-83e9-b5806fe68bea tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9" status: 200 len: 1266 microversion: 2.1 time: 0.178883 Jun 24 09:53:47.676149 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 516/1052] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:47 2022] GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:48.693125 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-191cb801-3062-4006-a22e-9971fd6cd012 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:48.693754 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-191cb801-3062-4006-a22e-9971fd6cd012 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 3e21a450-afb9-4139-8fa8-6804a81e88e9] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:48.700765 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-191cb801-3062-4006-a22e-9971fd6cd012 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:48.701238 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-191cb801-3062-4006-a22e-9971fd6cd012 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:48.702027 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-191cb801-3062-4006-a22e-9971fd6cd012 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:48.702466 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-191cb801-3062-4006-a22e-9971fd6cd012 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:48.849041 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-191cb801-3062-4006-a22e-9971fd6cd012 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:53:48.856816 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-191cb801-3062-4006-a22e-9971fd6cd012 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9" status: 200 len: 1266 microversion: 2.1 time: 0.167735 Jun 24 09:53:48.857359 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 537/1053] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:48 2022] GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:49.874343 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-29c7b63e-3946-4286-8a8d-54de15dd070b tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:49.875116 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-29c7b63e-3946-4286-8a8d-54de15dd070b tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 3e21a450-afb9-4139-8fa8-6804a81e88e9] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:49.884473 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-29c7b63e-3946-4286-8a8d-54de15dd070b tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:49.885028 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-29c7b63e-3946-4286-8a8d-54de15dd070b tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:49.885912 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-29c7b63e-3946-4286-8a8d-54de15dd070b tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:49.886424 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-29c7b63e-3946-4286-8a8d-54de15dd070b tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:49.904492 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=2 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:49.921620 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell0:SELECT=6 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:50.340448 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-29c7b63e-3946-4286-8a8d-54de15dd070b tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:53:50.349930 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-29c7b63e-3946-4286-8a8d-54de15dd070b tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9" status: 200 len: 1266 microversion: 2.1 time: 0.479506 Jun 24 09:53:50.350776 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 517/1054] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:49 2022] GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9 => generated 1266 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:50.667281 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-30d59499-414c-470f-bcfa-b754e88bba8e tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:50.668006 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-30d59499-414c-470f-bcfa-b754e88bba8e tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:50.669985 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-9922afce-7883-4494-b396-da0632200296 req-35ecf874-5768-4ba4-84ec-d4b794cbf11f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7a737cc-6f16-413d-9b3a-d6d32381ffa5", "tag": "ab20f504-ef6d-409e-9d0c-3918f4bb9c57"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:53:50.673280 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell0:SELECT=2 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:50.680973 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-9922afce-7883-4494-b396-da0632200296 req-35ecf874-5768-4ba4-84ec-d4b794cbf11f service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:50.681246 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-30d59499-414c-470f-bcfa-b754e88bba8e tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:50.681511 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-9922afce-7883-4494-b396-da0632200296 req-35ecf874-5768-4ba4-84ec-d4b794cbf11f service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:50.681687 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-30d59499-414c-470f-bcfa-b754e88bba8e tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:50.682674 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-30d59499-414c-470f-bcfa-b754e88bba8e tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:50.686942 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-30d59499-414c-470f-bcfa-b754e88bba8e tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:50.695119 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-9922afce-7883-4494-b396-da0632200296 req-35ecf874-5768-4ba4-84ec-d4b794cbf11f service nova] Creating event network-changed:ab20f504-ef6d-409e-9d0c-3918f4bb9c57 for instance e7a737cc-6f16-413d-9b3a-d6d32381ffa5 on hv-cinder-80382 Jun 24 09:53:50.701334 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-9922afce-7883-4494-b396-da0632200296 req-35ecf874-5768-4ba4-84ec-d4b794cbf11f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036332 Jun 24 09:53:50.702339 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 518/1055] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:53:50.717928 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-30d59499-414c-470f-bcfa-b754e88bba8e tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Going to try to terminate instance {{(pid=124339) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:53:50.831389 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-30d59499-414c-470f-bcfa-b754e88bba8e tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 204 len: 0 microversion: 2.1 time: 0.167834 Jun 24 09:53:50.840818 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 538/1056] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:53:50 2022] DELETE /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:53:50.849254 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-32c21060-7aba-46c1-aca4-ff2060543e5a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:50.850134 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-32c21060-7aba-46c1-aca4-ff2060543e5a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:50.861962 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-32c21060-7aba-46c1-aca4-ff2060543e5a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:50.862704 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-32c21060-7aba-46c1-aca4-ff2060543e5a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:50.863694 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-32c21060-7aba-46c1-aca4-ff2060543e5a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:50.864255 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-32c21060-7aba-46c1-aca4-ff2060543e5a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:51.055750 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-32c21060-7aba-46c1-aca4-ff2060543e5a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:53:51.065442 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-32c21060-7aba-46c1-aca4-ff2060543e5a tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1568 microversion: 2.1 time: 0.222365 Jun 24 09:53:51.076201 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 519/1057] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:50 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:51.367431 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f29eed6a-8335-4523-be27-b02eba877cdc tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:51.368166 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-f29eed6a-8335-4523-be27-b02eba877cdc tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 3e21a450-afb9-4139-8fa8-6804a81e88e9] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:51.374507 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f29eed6a-8335-4523-be27-b02eba877cdc tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:51.374953 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f29eed6a-8335-4523-be27-b02eba877cdc tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:51.375779 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f29eed6a-8335-4523-be27-b02eba877cdc tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:51.376214 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f29eed6a-8335-4523-be27-b02eba877cdc tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:51.527534 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-f29eed6a-8335-4523-be27-b02eba877cdc tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:53:51.535617 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f29eed6a-8335-4523-be27-b02eba877cdc tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9" status: 200 len: 1266 microversion: 2.1 time: 0.173202 Jun 24 09:53:51.536203 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 539/1058] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:51 2022] GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:52.085322 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-17deaf4d-1878-4369-a6c9-b4775e958fa2 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:52.085921 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-17deaf4d-1878-4369-a6c9-b4775e958fa2 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:52.093234 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-17deaf4d-1878-4369-a6c9-b4775e958fa2 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:52.093687 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-17deaf4d-1878-4369-a6c9-b4775e958fa2 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:52.094472 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-17deaf4d-1878-4369-a6c9-b4775e958fa2 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:52.094900 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-17deaf4d-1878-4369-a6c9-b4775e958fa2 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:52.325167 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-17deaf4d-1878-4369-a6c9-b4775e958fa2 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:53:52.334480 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-17deaf4d-1878-4369-a6c9-b4775e958fa2 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1568 microversion: 2.1 time: 0.254416 Jun 24 09:53:52.343862 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 520/1059] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:52 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1568 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:52.552685 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3a3deba7-b9c2-41ca-8649-0dec23dcf68a tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:52.553277 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3a3deba7-b9c2-41ca-8649-0dec23dcf68a tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 3e21a450-afb9-4139-8fa8-6804a81e88e9] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:52.560119 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3a3deba7-b9c2-41ca-8649-0dec23dcf68a tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:52.560578 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3a3deba7-b9c2-41ca-8649-0dec23dcf68a tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:52.561353 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3a3deba7-b9c2-41ca-8649-0dec23dcf68a tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:52.561786 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3a3deba7-b9c2-41ca-8649-0dec23dcf68a tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:52.778545 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3a3deba7-b9c2-41ca-8649-0dec23dcf68a tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:53:52.787270 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3a3deba7-b9c2-41ca-8649-0dec23dcf68a tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9" status: 200 len: 1266 microversion: 2.1 time: 0.238523 Jun 24 09:53:52.787773 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 540/1060] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:52 2022] GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:52.969948 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-4940b413-6bef-4681-9545-21785590482f req-d8dc78fb-9eed-498a-9182-bc807ac2b749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a737cc-6f16-413d-9b3a-d6d32381ffa5", "name": "network-vif-deleted", "tag": "ab20f504-ef6d-409e-9d0c-3918f4bb9c57"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:53:52.983948 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-4940b413-6bef-4681-9545-21785590482f req-d8dc78fb-9eed-498a-9182-bc807ac2b749 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:52.984381 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-4940b413-6bef-4681-9545-21785590482f req-d8dc78fb-9eed-498a-9182-bc807ac2b749 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:53.001263 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-4940b413-6bef-4681-9545-21785590482f req-d8dc78fb-9eed-498a-9182-bc807ac2b749 service nova] Creating event network-vif-deleted:ab20f504-ef6d-409e-9d0c-3918f4bb9c57 for instance e7a737cc-6f16-413d-9b3a-d6d32381ffa5 on hv-cinder-80382 Jun 24 09:53:53.007743 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-4940b413-6bef-4681-9545-21785590482f req-d8dc78fb-9eed-498a-9182-bc807ac2b749 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041360 Jun 24 09:53:53.008611 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 521/1061] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:53:53.119582 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [req-fb69c333-5dc6-45ed-aa31-9b181161476c req-ae709022-c0d3-4051-9b2a-a497568d2df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e21a450-afb9-4139-8fa8-6804a81e88e9", "name": "network-vif-plugged", "status": "completed", "tag": "ea03aaee-bcb4-4032-971d-c78ce5352beb"}]} {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:53:53.128891 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-fb69c333-5dc6-45ed-aa31-9b181161476c req-ae709022-c0d3-4051-9b2a-a497568d2df1 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:53.130221 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [req-fb69c333-5dc6-45ed-aa31-9b181161476c req-ae709022-c0d3-4051-9b2a-a497568d2df1 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:53.141965 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.compute.server_external_events [req-fb69c333-5dc6-45ed-aa31-9b181161476c req-ae709022-c0d3-4051-9b2a-a497568d2df1 service nova] Creating event network-vif-plugged:ea03aaee-bcb4-4032-971d-c78ce5352beb for instance 3e21a450-afb9-4139-8fa8-6804a81e88e9 on hv-cinder-80382 Jun 24 09:53:53.147590 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [req-fb69c333-5dc6-45ed-aa31-9b181161476c req-ae709022-c0d3-4051-9b2a-a497568d2df1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173309 Jun 24 09:53:53.148484 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 541/1062] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:53:53.354728 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-05149b6a-68eb-4898-8a4e-73cca790a6a5 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:53.356122 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-05149b6a-68eb-4898-8a4e-73cca790a6a5 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:53.368068 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-05149b6a-68eb-4898-8a4e-73cca790a6a5 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:53.368687 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-05149b6a-68eb-4898-8a4e-73cca790a6a5 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:53.369488 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-05149b6a-68eb-4898-8a4e-73cca790a6a5 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:53.369920 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-05149b6a-68eb-4898-8a4e-73cca790a6a5 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:53.456012 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-05149b6a-68eb-4898-8a4e-73cca790a6a5 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:53.456601 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-05149b6a-68eb-4898-8a4e-73cca790a6a5 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:53.457393 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.objects.instance [None req-05149b6a-68eb-4898-8a4e-73cca790a6a5 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lazy-loading 'fault' on Instance uuid e7a737cc-6f16-413d-9b3a-d6d32381ffa5 {{(pid=124338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:53:53.508701 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-05149b6a-68eb-4898-8a4e-73cca790a6a5 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c58a25e4cc44a8b1fd9e1edfabdc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cfee44c4264b0a8cfb5a93b7f5378a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:53:53.517675 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-05149b6a-68eb-4898-8a4e-73cca790a6a5 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 200 len: 1225 microversion: 2.1 time: 0.169130 Jun 24 09:53:53.518483 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 522/1063] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:53 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 1225 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:53.806408 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-3563643a-d359-4e68-80b1-05fee27614cc tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:53.807169 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-3563643a-d359-4e68-80b1-05fee27614cc tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 3e21a450-afb9-4139-8fa8-6804a81e88e9] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:53.814172 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3563643a-d359-4e68-80b1-05fee27614cc tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:53.814634 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3563643a-d359-4e68-80b1-05fee27614cc tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:53.815461 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3563643a-d359-4e68-80b1-05fee27614cc tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:53.815891 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-3563643a-d359-4e68-80b1-05fee27614cc tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:53.971450 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-3563643a-d359-4e68-80b1-05fee27614cc tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:53:53.979617 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-3563643a-d359-4e68-80b1-05fee27614cc tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9" status: 200 len: 1266 microversion: 2.1 time: 0.178336 Jun 24 09:53:53.980292 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 542/1064] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:53 2022] GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:54.541096 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-976fae26-2ffc-4fdb-a163-7707833e721b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:54.542216 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-976fae26-2ffc-4fdb-a163-7707833e721b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] [instance: e7a737cc-6f16-413d-9b3a-d6d32381ffa5] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:54.553305 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-976fae26-2ffc-4fdb-a163-7707833e721b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:54.554099 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-976fae26-2ffc-4fdb-a163-7707833e721b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:54.555470 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-976fae26-2ffc-4fdb-a163-7707833e721b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:54.556244 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-976fae26-2ffc-4fdb-a163-7707833e721b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:54.583307 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.wsgi [None req-976fae26-2ffc-4fdb-a163-7707833e721b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] HTTP exception thrown: Instance e7a737cc-6f16-413d-9b3a-d6d32381ffa5 could not be found. Jun 24 09:53:54.586552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-976fae26-2ffc-4fdb-a163-7707833e721b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Request method failure captured: Jun 24 09:53:54.586552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 HTTP/1.1 Jun 24 09:53:54.586552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:53:54.586552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:53:54.586552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:53:54.586552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 0 Jun 24 09:53:54.586552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:53:54.586552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:53:54.586552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:53:54.586552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:53:54.586552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYiqaaLUVXZOrQzJXQyaHgt8i9u1vr9XhwSULs3zcbcWxuwJO9CCwQasr4sPqbWY3mvI9wWp_zGVInUvo5-CkLWAjCkeIhvBya-lxsJTSZ4jEmlLF9F4xQlAvJBaEcLRKfAytZ_1udF5BaGfvhUMpzgH2cAmtFIM7hA-bYg7Z2ab6Hc Jun 24 09:53:54.586552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:53:54.586552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:53:54.586552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:53:54.586552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:53:54.586552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:53:54.586552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:53:54.586552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: 47cfee44c4264b0a8cfb5a93b7f5378a Jun 24 09:53:54.586552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-TestShelveInstance-874112126 Jun 24 09:53:54.586552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:53:54.586552 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:53:54.588280 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_47cfee44c4264b0a8cfb5a93b7f5378a", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/47cfee44c4264b0a8cfb5a93b7f5378a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/47cfee44c4264b0a8cfb5a93b7f5378a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/47cfee44c4264b0a8cfb5a93b7f5378a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:53:54.588280 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-TestShelveInstance-874112126 Jun 24 09:53:54.588280 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: 47cfee44c4264b0a8cfb5a93b7f5378a Jun 24 09:53:54.588280 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-TestShelveInstance-874112126 Jun 24 09:53:54.588280 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-TestShelveInstance-874112126-project Jun 24 09:53:54.588280 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:53:54.588280 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:53:54.588280 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: b2c58a25e4cc44a8b1fd9e1edfabdc02 Jun 24 09:53:54.588280 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-TestShelveInstance-874112126-project Jun 24 09:53:54.588280 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: > Jun 24 09:53:54.588280 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Instance e7a737cc-6f16-413d-9b3a-d6d32381ffa5 could not be found. Jun 24 09:53:54.588280 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'id': 'e7a737cc-6f16-413d-9b3a-d6d32381ffa5'} Jun 24 09:53:54.589284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:53:54.589284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:54.589284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:53:54.589284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:53:54.589284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:53:54.589284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:53:54.589284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:53:54.589284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:53:54.589284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:53:54.589284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:53:54.589284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a737cc-6f16-413d-9b3a-d6d32381ffa5 could not be found. Jun 24 09:53:54.589284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:54.589284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:54.589284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:54.589284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:54.589284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:54.589284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:54.589284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:53:54.589284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:53:54.589284 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:53:54.590904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:53:54.590904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:53:54.590904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:53:54.590904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:53:54.590904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:53:54.590904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:53:54.590904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:53:54.590904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a737cc-6f16-413d-9b3a-d6d32381ffa5 could not be found. Jun 24 09:53:54.590904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:54.590904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:53:54.590904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:54.590904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:53:54.590904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:53:54.590904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:53:54.590904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:53:54.590904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:53:54.590904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a737cc-6f16-413d-9b3a-d6d32381ffa5 could not be found. Jun 24 09:53:54.590904 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:53:54.592332 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-976fae26-2ffc-4fdb-a163-7707833e721b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Returning 404 to user: Instance e7a737cc-6f16-413d-9b3a-d6d32381ffa5 could not be found. {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:53:54.592332 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-976fae26-2ffc-4fdb-a163-7707833e721b tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5" status: 404 len: 111 microversion: 2.1 time: 0.056629 Jun 24 09:53:54.592332 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 523/1065] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:54 2022] GET /compute/v2.1/servers/e7a737cc-6f16-413d-9b3a-d6d32381ffa5 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:53:54.782023 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-75620590-8dc2-4501-b264-445e8a21d173 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] Calling method '.version_select at 0x7fc6d44b48b0>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:54.802659 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-75620590-8dc2-4501-b264-445e8a21d173 tempest-TestShelveInstance-874112126 tempest-TestShelveInstance-874112126-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1010644307" status: 202 len: 0 microversion: 2.1 time: 0.024027 Jun 24 09:53:54.803481 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 543/1066] 10.222.0.65 () {58 vars in 1253 bytes} [Fri Jun 24 09:53:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1010644307 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:53:54.997248 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-daa46155-e572-48af-9d3a-74ac9bff8bb2 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:54.997756 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-daa46155-e572-48af-9d3a-74ac9bff8bb2 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 3e21a450-afb9-4139-8fa8-6804a81e88e9] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:55.004545 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-daa46155-e572-48af-9d3a-74ac9bff8bb2 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:55.004974 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-daa46155-e572-48af-9d3a-74ac9bff8bb2 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:55.005773 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-daa46155-e572-48af-9d3a-74ac9bff8bb2 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:55.006201 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-daa46155-e572-48af-9d3a-74ac9bff8bb2 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:55.220272 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-daa46155-e572-48af-9d3a-74ac9bff8bb2 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:53:55.229237 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-daa46155-e572-48af-9d3a-74ac9bff8bb2 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9" status: 200 len: 1453 microversion: 2.1 time: 0.236127 Jun 24 09:53:55.230045 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 524/1067] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:54 2022] GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9 => generated 1453 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:55.246333 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-f30f4740-2f8b-4469-add5-11711c0dc4ed tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:55.246965 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-f30f4740-2f8b-4469-add5-11711c0dc4ed tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 3e21a450-afb9-4139-8fa8-6804a81e88e9] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:53:55.253925 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f30f4740-2f8b-4469-add5-11711c0dc4ed tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:55.254748 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f30f4740-2f8b-4469-add5-11711c0dc4ed tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:55.255792 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f30f4740-2f8b-4469-add5-11711c0dc4ed tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:55.256155 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-f30f4740-2f8b-4469-add5-11711c0dc4ed tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:55.472852 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-f30f4740-2f8b-4469-add5-11711c0dc4ed tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:53:55.481068 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-f30f4740-2f8b-4469-add5-11711c0dc4ed tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9" status: 200 len: 1453 microversion: 2.1 time: 0.238509 Jun 24 09:53:55.492864 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 544/1068] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:53:55 2022] GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9 => generated 1453 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:57.385479 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-ff844ce4-49bd-4123-b65b-3f9f2b0757e6 req-7a148665-4888-4f7b-b4e9-76002e2046f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e21a450-afb9-4139-8fa8-6804a81e88e9", "tag": "ea03aaee-bcb4-4032-971d-c78ce5352beb"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:53:57.396516 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-ff844ce4-49bd-4123-b65b-3f9f2b0757e6 req-7a148665-4888-4f7b-b4e9-76002e2046f4 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:53:57.396960 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-ff844ce4-49bd-4123-b65b-3f9f2b0757e6 req-7a148665-4888-4f7b-b4e9-76002e2046f4 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:53:57.410022 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-ff844ce4-49bd-4123-b65b-3f9f2b0757e6 req-7a148665-4888-4f7b-b4e9-76002e2046f4 service nova] Creating event network-changed:ea03aaee-bcb4-4032-971d-c78ce5352beb for instance 3e21a450-afb9-4139-8fa8-6804a81e88e9 on hv-cinder-80382 Jun 24 09:53:57.416303 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-ff844ce4-49bd-4123-b65b-3f9f2b0757e6 req-7a148665-4888-4f7b-b4e9-76002e2046f4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119216 Jun 24 09:53:57.417170 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 525/1069] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:55:25.973180 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:55:25.974499 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG dbcounter [-] [124339] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:55:25.975200 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:55:25.976154 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG dbcounter [-] [124338] Writing DB stats nova_cell1:SELECT=62 {{(pid=124338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:55:25.979437 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-9e93c800-7ca8-4d2b-af16-1e5b123e3c88 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:55:25.980069 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-9e93c800-7ca8-4d2b-af16-1e5b123e3c88 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 3e21a450-afb9-4139-8fa8-6804a81e88e9] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:55:25.981115 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-1818d4a5-70a8-4b42-a852-901554f51e6f req-193a8ece-a0e1-4b3f-85c1-974a529f9df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e21a450-afb9-4139-8fa8-6804a81e88e9", "tag": "ea03aaee-bcb4-4032-971d-c78ce5352beb"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:55:25.989328 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9e93c800-7ca8-4d2b-af16-1e5b123e3c88 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:25.989879 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9e93c800-7ca8-4d2b-af16-1e5b123e3c88 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:25.990751 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9e93c800-7ca8-4d2b-af16-1e5b123e3c88 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:25.991330 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-1818d4a5-70a8-4b42-a852-901554f51e6f req-193a8ece-a0e1-4b3f-85c1-974a529f9df4 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:25.991469 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-9e93c800-7ca8-4d2b-af16-1e5b123e3c88 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:25.991661 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-1818d4a5-70a8-4b42-a852-901554f51e6f req-193a8ece-a0e1-4b3f-85c1-974a529f9df4 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:26.004083 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-1818d4a5-70a8-4b42-a852-901554f51e6f req-193a8ece-a0e1-4b3f-85c1-974a529f9df4 service nova] Creating event network-changed:ea03aaee-bcb4-4032-971d-c78ce5352beb for instance 3e21a450-afb9-4139-8fa8-6804a81e88e9 on hv-cinder-80382 Jun 24 09:55:26.011157 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-1818d4a5-70a8-4b42-a852-901554f51e6f req-193a8ece-a0e1-4b3f-85c1-974a529f9df4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038201 Jun 24 09:55:26.011979 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 526/1070] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:55:26.022273 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-9e93c800-7ca8-4d2b-af16-1e5b123e3c88 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 3e21a450-afb9-4139-8fa8-6804a81e88e9] Going to try to terminate instance {{(pid=124339) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:55:26.112168 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-9e93c800-7ca8-4d2b-af16-1e5b123e3c88 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9" status: 204 len: 0 microversion: 2.1 time: 0.140607 Jun 24 09:55:26.113182 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 545/1071] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:55:25 2022] DELETE /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:55:26.122103 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-745e46a7-8036-4936-80cd-68f8a4c7cacb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:55:26.123328 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-745e46a7-8036-4936-80cd-68f8a4c7cacb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 3e21a450-afb9-4139-8fa8-6804a81e88e9] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:55:26.130462 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-745e46a7-8036-4936-80cd-68f8a4c7cacb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:26.131068 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-745e46a7-8036-4936-80cd-68f8a4c7cacb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:26.131857 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-745e46a7-8036-4936-80cd-68f8a4c7cacb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:26.132297 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-745e46a7-8036-4936-80cd-68f8a4c7cacb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:26.284973 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-745e46a7-8036-4936-80cd-68f8a4c7cacb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:55:26.292889 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-745e46a7-8036-4936-80cd-68f8a4c7cacb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9" status: 200 len: 1578 microversion: 2.1 time: 0.175233 Jun 24 09:55:26.293467 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 527/1072] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:55:26 2022] GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9 => generated 1578 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:55:27.312061 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-626ac26a-e7ba-4df4-9750-95436e86d5fb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:55:27.312874 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-626ac26a-e7ba-4df4-9750-95436e86d5fb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 3e21a450-afb9-4139-8fa8-6804a81e88e9] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:55:27.319958 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-626ac26a-e7ba-4df4-9750-95436e86d5fb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:27.320407 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-626ac26a-e7ba-4df4-9750-95436e86d5fb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:27.321184 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-626ac26a-e7ba-4df4-9750-95436e86d5fb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:27.321613 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-626ac26a-e7ba-4df4-9750-95436e86d5fb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:27.525251 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-626ac26a-e7ba-4df4-9750-95436e86d5fb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:55:27.533689 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-626ac26a-e7ba-4df4-9750-95436e86d5fb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9" status: 200 len: 1578 microversion: 2.1 time: 0.226236 Jun 24 09:55:27.534317 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 546/1073] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:55:27 2022] GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9 => generated 1578 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:55:28.144761 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-bd7b61f6-510e-45d1-9a6d-97d3ca7dc291 req-855150a0-53b5-40d2-b26c-91f11cb6f341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e21a450-afb9-4139-8fa8-6804a81e88e9", "name": "network-vif-deleted", "tag": "ea03aaee-bcb4-4032-971d-c78ce5352beb"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:55:28.154118 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-bd7b61f6-510e-45d1-9a6d-97d3ca7dc291 req-855150a0-53b5-40d2-b26c-91f11cb6f341 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:28.154700 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-bd7b61f6-510e-45d1-9a6d-97d3ca7dc291 req-855150a0-53b5-40d2-b26c-91f11cb6f341 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:28.166702 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-bd7b61f6-510e-45d1-9a6d-97d3ca7dc291 req-855150a0-53b5-40d2-b26c-91f11cb6f341 service nova] Creating event network-vif-deleted:ea03aaee-bcb4-4032-971d-c78ce5352beb for instance 3e21a450-afb9-4139-8fa8-6804a81e88e9 on hv-cinder-80382 Jun 24 09:55:28.172194 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-bd7b61f6-510e-45d1-9a6d-97d3ca7dc291 req-855150a0-53b5-40d2-b26c-91f11cb6f341 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031158 Jun 24 09:55:28.172929 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 528/1074] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:55:28.551604 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-576b1245-062a-4242-a375-9d193679eea8 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:55:28.552234 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-576b1245-062a-4242-a375-9d193679eea8 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 3e21a450-afb9-4139-8fa8-6804a81e88e9] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:55:28.559558 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-576b1245-062a-4242-a375-9d193679eea8 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:28.560116 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-576b1245-062a-4242-a375-9d193679eea8 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:28.560932 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-576b1245-062a-4242-a375-9d193679eea8 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:28.561375 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-576b1245-062a-4242-a375-9d193679eea8 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:28.596686 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-576b1245-062a-4242-a375-9d193679eea8 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:28.597140 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-576b1245-062a-4242-a375-9d193679eea8 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:28.597589 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.objects.instance [None req-576b1245-062a-4242-a375-9d193679eea8 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lazy-loading 'fault' on Instance uuid 3e21a450-afb9-4139-8fa8-6804a81e88e9 {{(pid=124339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:55:28.640417 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-576b1245-062a-4242-a375-9d193679eea8 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:55:28.649834 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-576b1245-062a-4242-a375-9d193679eea8 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9" status: 200 len: 1230 microversion: 2.1 time: 0.102418 Jun 24 09:55:28.650412 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 547/1075] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:55:28 2022] GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9 => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:55:29.540863 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:55:29.541172 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Fri Jun 24 09:55:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:55:29.670133 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-e97ecd61-6d61-4aeb-be50-44a19ded072e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:55:29.670747 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-e97ecd61-6d61-4aeb-be50-44a19ded072e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 3e21a450-afb9-4139-8fa8-6804a81e88e9] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:55:29.680114 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e97ecd61-6d61-4aeb-be50-44a19ded072e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:29.680650 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e97ecd61-6d61-4aeb-be50-44a19ded072e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:29.681436 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e97ecd61-6d61-4aeb-be50-44a19ded072e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:29.681957 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-e97ecd61-6d61-4aeb-be50-44a19ded072e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:29.699964 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.wsgi [None req-e97ecd61-6d61-4aeb-be50-44a19ded072e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] HTTP exception thrown: Instance 3e21a450-afb9-4139-8fa8-6804a81e88e9 could not be found. Jun 24 09:55:29.701934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-e97ecd61-6d61-4aeb-be50-44a19ded072e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Request method failure captured: Jun 24 09:55:29.701934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9 HTTP/1.1 Jun 24 09:55:29.701934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:55:29.701934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:55:29.701934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:55:29.701934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 0 Jun 24 09:55:29.701934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:55:29.701934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:55:29.701934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:55:29.701934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:55:29.701934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYh2ob1GHCcN-weHeG-Yac33duC5pDLbhXA2lL77Lk21dmO84PU8CihYA67SrDmkkCMfDzOmxDcXAbwHthndPsqxUppcC7KgpE7NPhkI-XK7ZElQOwuH350qhFEkbh-AWvtFJ4cp9aoT05wS4VX4vOI6VNrtXiciEJM-jZ7ZA9vIzGM Jun 24 09:55:29.701934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:55:29.701934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:55:29.701934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:55:29.701934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:55:29.701934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:55:29.701934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:55:29.701934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: 86f042cb88b7426ea9733f70033b55e3 Jun 24 09:55:29.701934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-TestVolumeBootPattern-1317904589 Jun 24 09:55:29.701934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:55:29.701934 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:55:29.704953 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_86f042cb88b7426ea9733f70033b55e3", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/86f042cb88b7426ea9733f70033b55e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/86f042cb88b7426ea9733f70033b55e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/86f042cb88b7426ea9733f70033b55e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:55:29.704953 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-TestVolumeBootPattern-1317904589 Jun 24 09:55:29.704953 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: 86f042cb88b7426ea9733f70033b55e3 Jun 24 09:55:29.704953 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-TestVolumeBootPattern-1317904589 Jun 24 09:55:29.704953 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-TestVolumeBootPattern-1317904589-project Jun 24 09:55:29.704953 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:55:29.704953 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:55:29.704953 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: 565cc9705a94454b9e68595b85c6a286 Jun 24 09:55:29.704953 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-TestVolumeBootPattern-1317904589-project Jun 24 09:55:29.704953 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: > Jun 24 09:55:29.704953 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Instance 3e21a450-afb9-4139-8fa8-6804a81e88e9 could not be found. Jun 24 09:55:29.704953 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'id': '3e21a450-afb9-4139-8fa8-6804a81e88e9'} Jun 24 09:55:29.706716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:55:29.706716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:55:29.706716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:55:29.706716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:55:29.706716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:55:29.706716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:55:29.706716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:55:29.706716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:55:29.706716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:55:29.706716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:55:29.706716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e21a450-afb9-4139-8fa8-6804a81e88e9 could not be found. Jun 24 09:55:29.706716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:55:29.706716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:55:29.706716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:55:29.706716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:55:29.706716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:55:29.706716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:55:29.706716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:55:29.706716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:55:29.706716 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:55:29.708988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:55:29.708988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:55:29.708988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:55:29.708988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:55:29.708988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:55:29.708988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:55:29.708988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:55:29.708988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e21a450-afb9-4139-8fa8-6804a81e88e9 could not be found. Jun 24 09:55:29.708988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:55:29.708988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:55:29.708988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:55:29.708988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:55:29.708988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:55:29.708988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:55:29.708988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:55:29.708988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:55:29.708988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e21a450-afb9-4139-8fa8-6804a81e88e9 could not be found. Jun 24 09:55:29.708988 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:55:29.710483 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-e97ecd61-6d61-4aeb-be50-44a19ded072e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Returning 404 to user: Instance 3e21a450-afb9-4139-8fa8-6804a81e88e9 could not be found. {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:55:29.710483 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-e97ecd61-6d61-4aeb-be50-44a19ded072e tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9" status: 404 len: 111 microversion: 2.1 time: 0.038699 Jun 24 09:55:29.710483 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 529/1076] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:55:29 2022] GET /compute/v2.1/servers/3e21a450-afb9-4139-8fa8-6804a81e88e9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:55:32.908543 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-e8456af0-938b-49d6-a46e-df503912f9ec req-41e6457a-1d12-49cd-9314-69ca8870dc86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2590ea8-3eb7-4a3e-ad98-75df30f2c860", "tag": "25bf3243-4587-41bb-aca6-0b4879099ded"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:55:32.919595 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-e8456af0-938b-49d6-a46e-df503912f9ec req-41e6457a-1d12-49cd-9314-69ca8870dc86 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:32.920012 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-e8456af0-938b-49d6-a46e-df503912f9ec req-41e6457a-1d12-49cd-9314-69ca8870dc86 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:32.920888 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-8e8000e4-b65e-456d-8b06-0dd7f74613fe tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:55:32.921623 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-8e8000e4-b65e-456d-8b06-0dd7f74613fe tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: f2590ea8-3eb7-4a3e-ad98-75df30f2c860] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:55:32.930545 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8e8000e4-b65e-456d-8b06-0dd7f74613fe tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:32.931522 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8e8000e4-b65e-456d-8b06-0dd7f74613fe tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:32.932759 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8e8000e4-b65e-456d-8b06-0dd7f74613fe tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:32.932986 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-e8456af0-938b-49d6-a46e-df503912f9ec req-41e6457a-1d12-49cd-9314-69ca8870dc86 service nova] Creating event network-changed:25bf3243-4587-41bb-aca6-0b4879099ded for instance f2590ea8-3eb7-4a3e-ad98-75df30f2c860 on hv-cinder-80382 Jun 24 09:55:32.933825 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-8e8000e4-b65e-456d-8b06-0dd7f74613fe tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:32.938543 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-e8456af0-938b-49d6-a46e-df503912f9ec req-41e6457a-1d12-49cd-9314-69ca8870dc86 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034878 Jun 24 09:55:32.943684 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 530/1077] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:55:32.972843 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-8e8000e4-b65e-456d-8b06-0dd7f74613fe tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: f2590ea8-3eb7-4a3e-ad98-75df30f2c860] Going to try to terminate instance {{(pid=124339) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:55:33.072256 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-8e8000e4-b65e-456d-8b06-0dd7f74613fe tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860" status: 204 len: 0 microversion: 2.1 time: 0.155833 Jun 24 09:55:33.073639 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 548/1078] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:55:32 2022] DELETE /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:55:33.085504 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-ccb65ade-65d4-499d-a4e4-a48148e595f9 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:55:33.086757 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-ccb65ade-65d4-499d-a4e4-a48148e595f9 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: f2590ea8-3eb7-4a3e-ad98-75df30f2c860] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:55:33.094903 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ccb65ade-65d4-499d-a4e4-a48148e595f9 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:33.096085 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ccb65ade-65d4-499d-a4e4-a48148e595f9 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:33.097206 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ccb65ade-65d4-499d-a4e4-a48148e595f9 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:33.097795 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-ccb65ade-65d4-499d-a4e4-a48148e595f9 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:33.542453 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.policy [None req-ccb65ade-65d4-499d-a4e4-a48148e595f9 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124338) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:55:33.551170 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-ccb65ade-65d4-499d-a4e4-a48148e595f9 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860" status: 200 len: 1577 microversion: 2.1 time: 0.472679 Jun 24 09:55:33.551762 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 531/1079] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:55:33 2022] GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860 => generated 1577 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:55:34.570875 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-177e5550-cd30-4d56-b46b-f9e3bd226ca0 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:55:34.571576 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-177e5550-cd30-4d56-b46b-f9e3bd226ca0 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: f2590ea8-3eb7-4a3e-ad98-75df30f2c860] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:55:34.578457 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-177e5550-cd30-4d56-b46b-f9e3bd226ca0 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:34.578913 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-177e5550-cd30-4d56-b46b-f9e3bd226ca0 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:34.579731 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-177e5550-cd30-4d56-b46b-f9e3bd226ca0 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:34.580172 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-177e5550-cd30-4d56-b46b-f9e3bd226ca0 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:34.827391 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.policy [None req-177e5550-cd30-4d56-b46b-f9e3bd226ca0 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cc9705a94454b9e68595b85c6a286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f042cb88b7426ea9733f70033b55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124339) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:55:34.836232 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-177e5550-cd30-4d56-b46b-f9e3bd226ca0 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860" status: 200 len: 1577 microversion: 2.1 time: 0.269710 Jun 24 09:55:34.836806 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 549/1080] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:55:34 2022] GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860 => generated 1577 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:55:35.155771 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [req-e8e8b0bb-6d49-4054-8cdd-de1d19cf6beb req-d230b060-146d-4d9f-a68a-bc3bae5a13c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2590ea8-3eb7-4a3e-ad98-75df30f2c860", "name": "network-vif-deleted", "tag": "25bf3243-4587-41bb-aca6-0b4879099ded"}]} {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:55:35.165089 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-e8e8b0bb-6d49-4054-8cdd-de1d19cf6beb req-d230b060-146d-4d9f-a68a-bc3bae5a13c2 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:35.165606 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [req-e8e8b0bb-6d49-4054-8cdd-de1d19cf6beb req-d230b060-146d-4d9f-a68a-bc3bae5a13c2 service nova] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:35.178482 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.compute.server_external_events [req-e8e8b0bb-6d49-4054-8cdd-de1d19cf6beb req-d230b060-146d-4d9f-a68a-bc3bae5a13c2 service nova] Creating event network-vif-deleted:25bf3243-4587-41bb-aca6-0b4879099ded for instance f2590ea8-3eb7-4a3e-ad98-75df30f2c860 on hv-cinder-80382 Jun 24 09:55:35.184560 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [req-e8e8b0bb-6d49-4054-8cdd-de1d19cf6beb req-d230b060-146d-4d9f-a68a-bc3bae5a13c2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032574 Jun 24 09:55:35.185333 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 532/1081] 10.222.0.65 () {64 vars in 1317 bytes} [Fri Jun 24 09:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:55:35.853574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-d0cf4636-766a-4f80-a29a-7f221c107999 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:55:35.854179 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-d0cf4636-766a-4f80-a29a-7f221c107999 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: f2590ea8-3eb7-4a3e-ad98-75df30f2c860] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:55:35.861278 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d0cf4636-766a-4f80-a29a-7f221c107999 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:35.861796 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d0cf4636-766a-4f80-a29a-7f221c107999 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:35.863111 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d0cf4636-766a-4f80-a29a-7f221c107999 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:35.863568 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-d0cf4636-766a-4f80-a29a-7f221c107999 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:35.877036 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-d0cf4636-766a-4f80-a29a-7f221c107999 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] HTTP exception thrown: Instance f2590ea8-3eb7-4a3e-ad98-75df30f2c860 could not be found. Jun 24 09:55:35.879178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-d0cf4636-766a-4f80-a29a-7f221c107999 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Request method failure captured: Jun 24 09:55:35.879178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860 HTTP/1.1 Jun 24 09:55:35.879178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:55:35.879178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:55:35.879178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:55:35.879178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:55:35.879178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:55:35.879178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:55:35.879178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:55:35.879178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:55:35.879178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYh2ob1GHCcN-weHeG-Yac33duC5pDLbhXA2lL77Lk21dmO84PU8CihYA67SrDmkkCMfDzOmxDcXAbwHthndPsqxUppcC7KgpE7NPhkI-XK7ZElQOwuH350qhFEkbh-AWvtFJ4cp9aoT05wS4VX4vOI6VNrtXiciEJM-jZ7ZA9vIzGM Jun 24 09:55:35.879178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:55:35.879178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:55:35.879178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:55:35.879178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:55:35.879178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:55:35.879178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:55:35.879178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 86f042cb88b7426ea9733f70033b55e3 Jun 24 09:55:35.879178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-TestVolumeBootPattern-1317904589 Jun 24 09:55:35.879178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:55:35.879178 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:55:35.880893 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_86f042cb88b7426ea9733f70033b55e3", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/86f042cb88b7426ea9733f70033b55e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/86f042cb88b7426ea9733f70033b55e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/86f042cb88b7426ea9733f70033b55e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:55:35.880893 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-TestVolumeBootPattern-1317904589 Jun 24 09:55:35.880893 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 86f042cb88b7426ea9733f70033b55e3 Jun 24 09:55:35.880893 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-TestVolumeBootPattern-1317904589 Jun 24 09:55:35.880893 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-TestVolumeBootPattern-1317904589-project Jun 24 09:55:35.880893 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:55:35.880893 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:55:35.880893 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: 565cc9705a94454b9e68595b85c6a286 Jun 24 09:55:35.880893 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-TestVolumeBootPattern-1317904589-project Jun 24 09:55:35.880893 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:55:35.880893 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance f2590ea8-3eb7-4a3e-ad98-75df30f2c860 could not be found. Jun 24 09:55:35.880893 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': 'f2590ea8-3eb7-4a3e-ad98-75df30f2c860'} Jun 24 09:55:35.881858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:55:35.881858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:55:35.881858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:55:35.881858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:55:35.881858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:55:35.881858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:55:35.881858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:55:35.881858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:55:35.881858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:55:35.881858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:55:35.881858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2590ea8-3eb7-4a3e-ad98-75df30f2c860 could not be found. Jun 24 09:55:35.881858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:55:35.881858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:55:35.881858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:55:35.881858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:55:35.881858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:55:35.881858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:55:35.881858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:55:35.881858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:55:35.881858 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:55:35.883574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:55:35.883574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:55:35.883574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:55:35.883574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:55:35.883574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:55:35.883574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:55:35.883574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:55:35.883574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2590ea8-3eb7-4a3e-ad98-75df30f2c860 could not be found. Jun 24 09:55:35.883574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:55:35.883574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:55:35.883574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:55:35.883574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:55:35.883574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:55:35.883574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:55:35.883574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:55:35.883574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:55:35.883574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2590ea8-3eb7-4a3e-ad98-75df30f2c860 could not be found. Jun 24 09:55:35.883574 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:55:35.885076 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-d0cf4636-766a-4f80-a29a-7f221c107999 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Returning 404 to user: Instance f2590ea8-3eb7-4a3e-ad98-75df30f2c860 could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:55:35.885076 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-d0cf4636-766a-4f80-a29a-7f221c107999 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860" status: 404 len: 111 microversion: 2.1 time: 0.030979 Jun 24 09:55:35.885076 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 550/1082] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:55:35 2022] GET /compute/v2.1/servers/f2590ea8-3eb7-4a3e-ad98-75df30f2c860 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:55:36.391843 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-6ee7569a-5952-48b6-955b-d56ff9a8d3eb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:55:36.392520 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.compute.api [None req-6ee7569a-5952-48b6-955b-d56ff9a8d3eb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124338) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:55:36.400593 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6ee7569a-5952-48b6-955b-d56ff9a8d3eb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:36.401170 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6ee7569a-5952-48b6-955b-d56ff9a8d3eb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:36.402180 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6ee7569a-5952-48b6-955b-d56ff9a8d3eb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:36.402735 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG oslo_concurrency.lockutils [None req-6ee7569a-5952-48b6-955b-d56ff9a8d3eb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:36.419426 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.wsgi [None req-6ee7569a-5952-48b6-955b-d56ff9a8d3eb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] HTTP exception thrown: Instance 4e6afd14-78c2-4765-b7ed-dfd75579caad could not be found. Jun 24 09:55:36.421294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-6ee7569a-5952-48b6-955b-d56ff9a8d3eb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Request method failure captured: Jun 24 09:55:36.421294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: request: DELETE /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad HTTP/1.1 Jun 24 09:55:36.421294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept: application/json Jun 24 09:55:36.421294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Accept-Encoding: identity Jun 24 09:55:36.421294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Connection: close Jun 24 09:55:36.421294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Length: 0 Jun 24 09:55:36.421294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Content-Type: application/json Jun 24 09:55:36.421294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Host: 10.222.0.65 Jun 24 09:55:36.421294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Openstack-System-Scope: None Jun 24 09:55:36.421294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: User-Agent: python-urllib3/1.26.9 Jun 24 09:55:36.421294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Auth-Token: gAAAAABitYh2ob1GHCcN-weHeG-Yac33duC5pDLbhXA2lL77Lk21dmO84PU8CihYA67SrDmkkCMfDzOmxDcXAbwHthndPsqxUppcC7KgpE7NPhkI-XK7ZElQOwuH350qhFEkbh-AWvtFJ4cp9aoT05wS4VX4vOI6VNrtXiciEJM-jZ7ZA9vIzGM Jun 24 09:55:36.421294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Id: None Jun 24 09:55:36.421294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Domain-Name: None Jun 24 09:55:36.421294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Identity-Status: Confirmed Jun 24 09:55:36.421294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Is-Admin-Project: True Jun 24 09:55:36.421294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Id: default Jun 24 09:55:36.421294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Domain-Name: Default Jun 24 09:55:36.421294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Id: 86f042cb88b7426ea9733f70033b55e3 Jun 24 09:55:36.421294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Project-Name: tempest-TestVolumeBootPattern-1317904589 Jun 24 09:55:36.421294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Role: reader,member Jun 24 09:55:36.421294 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Roles: reader,member Jun 24 09:55:36.424063 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_86f042cb88b7426ea9733f70033b55e3", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/86f042cb88b7426ea9733f70033b55e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/86f042cb88b7426ea9733f70033b55e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/86f042cb88b7426ea9733f70033b55e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:55:36.424063 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant: tempest-TestVolumeBootPattern-1317904589 Jun 24 09:55:36.424063 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Id: 86f042cb88b7426ea9733f70033b55e3 Jun 24 09:55:36.424063 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-Tenant-Name: tempest-TestVolumeBootPattern-1317904589 Jun 24 09:55:36.424063 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User: tempest-TestVolumeBootPattern-1317904589-project Jun 24 09:55:36.424063 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Id: default Jun 24 09:55:36.424063 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Domain-Name: Default Jun 24 09:55:36.424063 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Id: 565cc9705a94454b9e68595b85c6a286 Jun 24 09:55:36.424063 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: X-User-Name: tempest-TestVolumeBootPattern-1317904589-project Jun 24 09:55:36.424063 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: method: > Jun 24 09:55:36.424063 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: exception: Instance 4e6afd14-78c2-4765-b7ed-dfd75579caad could not be found. Jun 24 09:55:36.424063 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: action_args: {'id': '4e6afd14-78c2-4765-b7ed-dfd75579caad'} Jun 24 09:55:36.425569 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:55:36.425569 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:55:36.425569 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:55:36.425569 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:55:36.425569 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:55:36.425569 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:55:36.425569 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:55:36.425569 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:55:36.425569 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:55:36.425569 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:55:36.425569 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e6afd14-78c2-4765-b7ed-dfd75579caad could not be found. Jun 24 09:55:36.425569 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:55:36.425569 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:55:36.425569 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:55:36.425569 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:55:36.425569 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:55:36.425569 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:55:36.425569 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:55:36.425569 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:55:36.425569 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:55:36.427709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:55:36.427709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 09:55:36.427709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 09:55:36.427709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 09:55:36.427709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 09:55:36.427709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:55:36.427709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:55:36.427709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:55:36.427709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:55:36.427709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e6afd14-78c2-4765-b7ed-dfd75579caad could not be found. Jun 24 09:55:36.427709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:55:36.427709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:55:36.427709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:55:36.427709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:55:36.427709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:55:36.427709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:55:36.427709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:55:36.427709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:55:36.427709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e6afd14-78c2-4765-b7ed-dfd75579caad could not be found. Jun 24 09:55:36.427709 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: ERROR nova.api.openstack.wsgi Jun 24 09:55:36.429617 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-6ee7569a-5952-48b6-955b-d56ff9a8d3eb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Returning 404 to user: Instance 4e6afd14-78c2-4765-b7ed-dfd75579caad could not be found. {{(pid=124338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:55:36.429617 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-6ee7569a-5952-48b6-955b-d56ff9a8d3eb tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 404 len: 111 microversion: 2.1 time: 0.036009 Jun 24 09:55:36.429617 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 533/1083] 10.222.0.65 () {58 vars in 1238 bytes} [Fri Jun 24 09:55:36 2022] DELETE /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:55:36.432983 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a01dee8c-315e-48ef-9f2e-685ddbc9e533 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '>' {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:55:36.433585 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.compute.api [None req-a01dee8c-315e-48ef-9f2e-685ddbc9e533 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] [instance: 4e6afd14-78c2-4765-b7ed-dfd75579caad] Fetching instance by UUID {{(pid=124339) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:55:36.440839 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a01dee8c-315e-48ef-9f2e-685ddbc9e533 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:36.441467 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a01dee8c-315e-48ef-9f2e-685ddbc9e533 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:36.442699 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a01dee8c-315e-48ef-9f2e-685ddbc9e533 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:55:36.443455 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG oslo_concurrency.lockutils [None req-a01dee8c-315e-48ef-9f2e-685ddbc9e533 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Lock "f2d2cbef-ff41-499b-a255-74c93eabe11c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:55:36.462312 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.wsgi [None req-a01dee8c-315e-48ef-9f2e-685ddbc9e533 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] HTTP exception thrown: Instance 4e6afd14-78c2-4765-b7ed-dfd75579caad could not be found. Jun 24 09:55:36.463883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a01dee8c-315e-48ef-9f2e-685ddbc9e533 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Request method failure captured: Jun 24 09:55:36.463883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: request: GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad HTTP/1.1 Jun 24 09:55:36.463883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept: application/json Jun 24 09:55:36.463883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Accept-Encoding: identity Jun 24 09:55:36.463883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Connection: close Jun 24 09:55:36.463883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Length: 0 Jun 24 09:55:36.463883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Content-Type: application/json Jun 24 09:55:36.463883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Host: 10.222.0.65 Jun 24 09:55:36.463883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Openstack-System-Scope: None Jun 24 09:55:36.463883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: User-Agent: python-urllib3/1.26.9 Jun 24 09:55:36.463883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Auth-Token: gAAAAABitYh2ob1GHCcN-weHeG-Yac33duC5pDLbhXA2lL77Lk21dmO84PU8CihYA67SrDmkkCMfDzOmxDcXAbwHthndPsqxUppcC7KgpE7NPhkI-XK7ZElQOwuH350qhFEkbh-AWvtFJ4cp9aoT05wS4VX4vOI6VNrtXiciEJM-jZ7ZA9vIzGM Jun 24 09:55:36.463883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Id: None Jun 24 09:55:36.463883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Domain-Name: None Jun 24 09:55:36.463883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Identity-Status: Confirmed Jun 24 09:55:36.463883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Is-Admin-Project: True Jun 24 09:55:36.463883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Id: default Jun 24 09:55:36.463883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Domain-Name: Default Jun 24 09:55:36.463883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Id: 86f042cb88b7426ea9733f70033b55e3 Jun 24 09:55:36.463883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Project-Name: tempest-TestVolumeBootPattern-1317904589 Jun 24 09:55:36.463883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Role: reader,member Jun 24 09:55:36.463883 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Roles: reader,member Jun 24 09:55:36.465374 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_86f042cb88b7426ea9733f70033b55e3", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/86f042cb88b7426ea9733f70033b55e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/86f042cb88b7426ea9733f70033b55e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/86f042cb88b7426ea9733f70033b55e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}] Jun 24 09:55:36.465374 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant: tempest-TestVolumeBootPattern-1317904589 Jun 24 09:55:36.465374 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Id: 86f042cb88b7426ea9733f70033b55e3 Jun 24 09:55:36.465374 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-Tenant-Name: tempest-TestVolumeBootPattern-1317904589 Jun 24 09:55:36.465374 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User: tempest-TestVolumeBootPattern-1317904589-project Jun 24 09:55:36.465374 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Id: default Jun 24 09:55:36.465374 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Domain-Name: Default Jun 24 09:55:36.465374 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Id: 565cc9705a94454b9e68595b85c6a286 Jun 24 09:55:36.465374 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: X-User-Name: tempest-TestVolumeBootPattern-1317904589-project Jun 24 09:55:36.465374 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: method: > Jun 24 09:55:36.465374 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: exception: Instance 4e6afd14-78c2-4765-b7ed-dfd75579caad could not be found. Jun 24 09:55:36.465374 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: action_args: {'id': '4e6afd14-78c2-4765-b7ed-dfd75579caad'} Jun 24 09:55:36.466263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: {{(pid=124339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:55:36.466263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:55:36.466263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:55:36.466263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:55:36.466263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:55:36.466263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:55:36.466263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:55:36.466263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:55:36.466263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:55:36.466263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:55:36.466263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e6afd14-78c2-4765-b7ed-dfd75579caad could not be found. Jun 24 09:55:36.466263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:55:36.466263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:55:36.466263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:55:36.466263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:55:36.466263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:55:36.466263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:55:36.466263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:55:36.466263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:55:36.466263 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:55:36.467777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:55:36.467777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:55:36.467777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:55:36.467777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:55:36.467777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:55:36.467777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:55:36.467777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:55:36.467777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e6afd14-78c2-4765-b7ed-dfd75579caad could not be found. Jun 24 09:55:36.467777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:55:36.467777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:55:36.467777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:55:36.467777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:55:36.467777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:55:36.467777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:55:36.467777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:55:36.467777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:55:36.467777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e6afd14-78c2-4765-b7ed-dfd75579caad could not be found. Jun 24 09:55:36.467777 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: ERROR nova.api.openstack.wsgi Jun 24 09:55:36.469484 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: DEBUG nova.api.openstack.wsgi [None req-a01dee8c-315e-48ef-9f2e-685ddbc9e533 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Returning 404 to user: Instance 4e6afd14-78c2-4765-b7ed-dfd75579caad could not be found. {{(pid=124339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:55:36.469484 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO nova.api.openstack.requestlog [None req-a01dee8c-315e-48ef-9f2e-685ddbc9e533 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad" status: 404 len: 111 microversion: 2.1 time: 0.036214 Jun 24 09:55:36.469484 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: [pid: 124339|app: 0|req: 551/1084] 10.222.0.65 () {58 vars in 1235 bytes} [Fri Jun 24 09:55:36 2022] GET /compute/v2.1/servers/4e6afd14-78c2-4765-b7ed-dfd75579caad => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 09:55:37.777965 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: DEBUG nova.api.openstack.wsgi [None req-fde9e8e0-3030-4674-a47e-d068a37d1a58 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] Calling method '.version_select at 0x7fc6d4c3dd30>' {{(pid=124338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:55:37.799334 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO nova.api.openstack.requestlog [None req-fde9e8e0-3030-4674-a47e-d068a37d1a58 tempest-TestVolumeBootPattern-1317904589 tempest-TestVolumeBootPattern-1317904589-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-853348123" status: 202 len: 0 microversion: 2.1 time: 0.025181 Jun 24 09:55:37.803607 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: [pid: 124338|app: 0|req: 534/1085] 10.222.0.65 () {58 vars in 1259 bytes} [Fri Jun 24 09:55:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-853348123 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:56:57.337595 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:56:57.338380 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Fri Jun 24 09:56:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:57:10.784323 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:57:10.785227 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Fri Jun 24 09:57:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:58:49.551841 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:58:49.553237 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Fri Jun 24 09:58:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:58:49.846898 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:58:49.846898 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Fri Jun 24 09:58:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:00:17.347580 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:00:17.348769 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Fri Jun 24 10:00:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:00:30.796069 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:00:30.796742 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Fri Jun 24 10:00:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:00:36.638234 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:00:36.638955 dv-cinder-803823-13-iscsi devstack@n-api.service[124339]: Fri Jun 24 10:00:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:00:47.616311 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:00:47.617034 dv-cinder-803823-13-iscsi devstack@n-api.service[124338]: Fri Jun 24 10:00:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!